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(57) ABSTRACT 

The invention provides a method and apparatus for enhanc- 
ing apparent image resolution by way of multi-line interpo- 
lation. A method for enhancing the resolution of low- 
resolution image -data includes the steps of: providing a 
memory [420] having independently addressable storage 
banks [420L,420R]; storing the low-resolution image-data 
[125] in the memory [420] such that low-resolution image- 
data defining a first low-resolution row [LRJ resides in a 
first of said storage banks [420R] and such that low- 
resolution image-data defining a second low-resolution row 
[LRj], adjacent to the first low-resolution row [LRq], resides 
in a second of said storage banks [420L]; extracting first 
through Nth low-resolution pixel signals [S-i-Sj] from the 
memory [420], said signals representing values of low- 
resolution pixels in the adjacent first and second low- 
resolution rows [LRq J-Ri] of the low-resolution image-data 
[125]; and producing a high-resolution pixel signal [Hpx] 
from said first through Nth low-resolution pixel signals 
[S1-S3] in accordance with a distance -weighted algorithm. 
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RESOLUTION ENHANCEMENT FOR VIDEO 
DISPLAY USING MULTI-LINE 
INTERPOLATION 

RELATED APPUCATIONS 5 

This application is a continuation of U.S. patent applica- 
tion Sen No. 08/477,457, filed on Jun. 7, 1995, now 
abandoned, which is a divisional application of U.S. patent 
application Ser. No. 07/970,287, filed on Nov. 2. 1992 and 
issued as U.S. Pat. No. 5,481,275 on Jan. 2. 1996. U.S. 
patent application Ser. No. 08/477,457 and U.S. Pat. No. 
5,481,275 are hereby incorporated by reference. 

BACKGROUND 
1. Field of the Invention 

Hie invention relates generally to digital image process- 
ing and the display of digitally generated images. The 
invention relates more specifically to the problem of creating 
high-resolution animated images in real time. 

2a. Copyright claims to disclosed Code-conversion Tables 

A portion of the disclosure of this patent document 
contains material which is subject to copyright protection. 
The copyright owner has no objection to the facsimile 25 
reproduction by anyone of the patent document or the patent 
disclosure as it appears in the U.S. Patent and Trademark 
OfiScc patent file or records, but otherwise reserves all 
copyri^t rights whatsoever. In particular, this application 
includes listings of code conversion tables named: ITPCON, 3^ 
HVON, HVOON. HVION. HV20N, HV30N. These code- 
conversion tables can be implemented by way of a computer 
program, microcode, in a ROM, and so forth. These code- 
conversion tables can also be implemented by way of 
combinatorial logic. Since implementations of the tables 35 
which are deemed to be "computer programs" are protect- 
able under copyright law, copyrights not otherwise waived 
above in said code-conversion listing? are reserved. This 
reservation includes the right to reproduce the code- 
conversion tables in the form of machine-executable com- ^ 
puter programs. 

2b. Cross Reference to Related Applications 

This application is related to: 

U.S. patent application Ser. No. 07/970,308 entiUed 
AUDIO/VIDEO COMPUTER ARCHITECTURE, by 
inventors Mical et al., filed concurrently herewith, Attorney 
Docket No. MDI04222; 

U.S. patent application Ser. No. 07/970,274 entided 
METHOD FOR GENERAHNG THREE DIMENSIONAL 
SOUND, by inventor David C. Piatt, filed concurrcndy 
herewith. Attorney Docket No. MDIO4220; 

U.S. patent application Ser. No. 07/970,278 entided 
METHOD FOR CONTROLUNG A SPRYTE RENDER- 
ING PROCESSOR, by inventors Mical et al., filed concur- 55 
rendy herewith, Attorney Docket No. MDIO3040; 

U.S. patent application Ser. No. 07/970,289 entided 
SPRYTE RENDERING SYSTEM WITH IMPROVED 
CORNER CALCULATING ENGINE AND IMPROVED 
POLYGON-PAINT ENGINE, by inventors Needle et al., eo 
filed concurrently herewith. Attorney Docket No. 
MDI04232; 

U.S. patent application Ser. No. 07/969,994 entiUcd 
METHOD AND APPARATUS FOR UPDAONG A GLUT 
DURING HORIZONTAL BLANKING, by inventors Mical 65 
et al., filed concurrenUy herewith. Attorney Docket No. 
MDIO4250; 
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U.S. patent application Ser. No. 07/970,083 entitled 
IMPROVED METHOD AND APPARATUS FOR PRO- 
CESSING IMAGE DATA, by inventors Mical et al., filed 
concunendy herewith, now U.S. Pat. No. 5,572,235, issued 
on Nov. 5, 1996; and 

U.S. patent application Ser. No. 07/970,151 entitled 
PLAYER BUS APPARATUS AND METHOD, by inventors 
Needle et aL, filed concurrently herewith. Attorney Docket 
No. MDIO4270. 

The related patent applications are all commonly assigned 
with the present applicadon and are all incorporated herein 
by reference in their entirety. 

3. Description of the Related Art 

In recent years, the presentation and pre-presentation 
processing of visual imagery has shifted fi-om what was 
primarily an analog electronic format to an essentially 
digital format. 

Unique problems come to play in the dig;ital processing of 
image data and the display of such image data. The more 
prominent problems include providing adequate storage 
capacity for digital image data and maintaining acceptable 
data throughput rates while using hardware of relatively low 
cost In addition, there is the problem of creating a sense of 
realism in digitally generated imagery, particularly in ani- 
mated imagery. 

The visual realism of imagery generated by digital video 
game systems, simulators and the like can be enhanced by 
providing special effects such as moving sprites, real-time 
changes in shadowing and/or highlighting,, smoothing of 
contours and so forth. 

Visual realism is further enhanced by increasing the 
apparent resolution of a displayed image so that it has a 
smooth photography-like quality rather than a grainy 
disjoined-blocks appearance of the type found in low- 
resolution computer-produced graphics of earlier years. 

Although bit-mapped computer images originate as a 
matrix of discrete lit or unlit pixels, the human eye can be 
fooled into perceiving an image having the desired 
photography-like continuity if a matrix format comprised of 
independently-shaded (and/or independenUy colored) pixels 
is provided having dimensions of approximately 500-by-500 
pixels or better at the point of display. 

The VGA graphics standard, which is used in many 
present-day low-lost computer systems, approximates this 
effect with a display matrix having dimensions of 640-by- 
480 pixels. Standard-definition NTSC broadcast television 
also approximates this effect with a display technology that 
relies on interlaced fields with 525 lines per pair of fields and 
a horizontal scan bandwidth (analog) that is equivalent to 
approximately 500 RGB colored dots per line. 

More advanced graphic display standards such as Super- 
VGA and High Definition Television (HDTV) rely on much 
higher resoludons, lQ24-by-786 pixels for example. It is 
expected that display standards with even higher resolution 
numbers (e.g., 2048-by-2048) will emerge in the future. 

As resolutions increase, the problem of providing 
adequate storage capacity for the corresponding digital 
image data becomes more acute. The problem of providing 
sufficient data processing throughput rates also becomes 
more acute. Hiis is particularly so if the additional constraint 
of keeping hardware costs within acceptable price versus 
performance ranges comes in to play. 

A display widi 640-by-480 independent pixels (307,200 
pixels total) calls for a video-speed memory unit (frame 
buffer) having at least 19 address bits or a corresponding 2^' 
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independently- addressable data words (a512K words), adjacent, low-resolution scan lines in adjacently addressable 

where eadi data word stores a binary code representing the memory locations; (b) means for extracting from the 

shading and/or color of an individual pixcL Each doubling memory unit, an interpolation group consisting of N low- 

of display resolution, say from 640-by-480 pixels to 1280- resolution pixel words, where N is an integer substantially 

by-960 pixels, calls for a four-fold increase in storage 5 less than the number of pixels in a low-resolution line; (c) 

capacdty This means an increase from 512K words to 2M interpolating means for interpolating the N low-resolution 

words (two Megawords) in Oie given example. And m cases j^el words of the interpolation group and producing there- 

whcre parts or all of the 1280-by-960 display field have to ^^^^ high-n:solution pixel words; and (d) 

be modified m real-Umc (to create a sense of anmiaUon), the high-resolution display means for displaying a light image 

four-fold increase or storage capacity calls for a correspond- . j- * t-T- • 1 

tag four-fold increase in data proceiing bandwidth (image '° ^''"^^ ° '^'^ high-resokUon pixel 

bil processed per second) as i)mpared to what was needed ^""l P"'*'""^ "itcrpolaUng means, 

for processing the 640-by-480 field. ^ method in accordance with the invention comprises the 

The benefit versus cost ratio incurred by demands for ^^P^ ^^""S low-resoluUon image-data in a memory 

more storage capacity and faster processing speed has to be ^^"^^^ mdependently addressable storage banks such that 

questioned at some point Perhaps the increase in perfor- low-resolution image-data defining a first low-resolution 

mance is not worth the increase in system cost. On the other ^^^^^^ ^ ^'^^ s^*"^g^ 

hand, it might be possible to create a perception of improved low-resolution image-data defining a second low-resolution 

performance without the burden of increased cost. "^^^ adjacent to the first low-resoluUon row, resides in a 

second of said storage banks; (b) extracting first through Nth 

SUMMARY OF THE INVEhOlON 20 low-resolution pixel signals [S^-S^] from the memory, said 

The invention overcomes the above-mentioned problems signals representing values of low-resolution pixels in the 
by using a low-resolution image representation within an adjacent first and second low-resohilion rows [LRq, LRj] of 
image data processing tmit and by enhancing apparent image the low-resolution image-data and producing a high- 
resolution through the use of interpolation prior to produc- resolution pixel signal [Hpx] from said first through Nth 
tion of a displayable version of the image. ^ low-resolution pbcel signals [S^-Sg] in accordance with a 

Instead of providing independent shading and/or coloring distance-weighted algorithm. 

and/or illumination control for each pixel of a high resolu- DnTci: i-iccr>DTtmoM ni? toc r^T> Ati/ixtr-e 
,•1 .V • J • . 1 4- L BRIEF DESCRIPTION OF THE DRAWINGS 
tion display, the mvcntion provides an mterpolation mecha- 
nism in which a first number, N, of low-resolution pixels The below detailed description makes reference to the 
determine the shading/coloring of a second larger number, ^ accompanying drawings, in which: 
M>N, of high-resolution pixels. piG. 1 is a block diagram of a first resolution enhancing 

In one particular embodiment, a flying window overlaps system in accordance with the invention, 

a small number (N=4) of low-resolution pixels (interpolation RG. 2 is a schematic diagram illustrating how a group of 

group) belongmg to adjacent roAvs. The contents of the low-resolution pixel datawords is interpolated to generate 

flying window are mterpolatcd m real time to produce a high-resolution pbcel data in accordance with the invention, 

larger number (M-16) of high resolution pixels in alternate pj^jg 3^ 3^ transform diagrams showing 

oda/evenlinepasses. A 320-by-240 matrix or low-resolution ^.i . ? * w • t..* i.- u t- 

. . , ^. . , ; . , . , one possible set of contnbution weiehtmes which can be 

stored pixek ^ .nlcr^latcd m real Ume to produce a ^ resolution enhancing system in accordance 

non-stored, dual-field, frame of toplay data with an appar- ^ invention. 

ent higher-resolution of 640-by-480 pixels. . , . , . .... 

J J L 1 £ J * ■ FIG. 3F shows a choice making system m which a 

The produced higher-resolution frame data is either u j- . j • c t-t^^c^ iti ^^t- 

^ w * ^ J* * subposition coordinates used m any of FIGS. 3B-3E are 

unmediately used or ultimately used to generate a light ^ »/ttt7\.i-i j .vc r 1 

*L /• • . J J * I. / J f converted to universal (UV) table identifiers of a commonly 
unage that is intended to be transmitted to the eyes of a . j 1. • 1 • . l/ j i. • r l • 
, I, ' J •*ju*u*u u- f** shared choice-making table and the choices of the choice- 
human bemg and appreciated by that human bemg for its , . ^ , , ^ ^ 1. i * 1. • j ^-^ r 

L ^ • 1 J/ 1. • I * * 45 making table are converted back to choice identifiers for 

opto-physiotogK:al and/or f«ycho-v,sual, graphic content. ^^^^^ ^^^^^^ ^ach of FIGS. 3B-3E. 

As such, high-resolution data signals that are produced m combine as indicated by the key in FIG. 4A 

accordance with the mvention ultimately manifest them- 1 « "^"^ ^ ^ lx^x^^ 

1 L • 11 1 *•* *t- to lorm a block diagram 01 a second resolution ennancine 

selves as significant parts of a physically real entity: the . ....... 

J- 1 J r J J system in accordance with the mvention. 

displayed image. 50 ' 

One embodiment of the invention avoids the need of a ^ ^ titning diagram showing the timing of 
row buffer for separately storing the image data of one or ^™ ^^Snals developed in the embodiment of FIG. 4A. 
more rows during multi-row interpolation. Source image F'G- is a schematic diagram of a CAPCLKEN gen- 
data is placed within independenUy addressable, parallel erating circuit, a slip-stream capture circuit and a VRAM 
banks of a multi-bank video random access memory unit 55 ^^^^ capture circuit in accordance with the invention. 
(VRAM). The image data is arranged sudi that pixels of FIG. 4E is a conceptual diagram showing data interleav- 
adjacent rows but a same colunm will be fetched in parallel ing in the pipelined structure of FIGS. 4A-B, showing the 
when same address signals are applied to each of the destacking of interleaved data and showing a CLUT-delay 
independently addressable banks of the multi-bank VRAM. matching function performed within an SP carrying pipe of 

The advantages of such an arrangement include reduced 60 system, 

demand for large -capacity video-speed memory, reduced FIG. 5 is a schematic diagram illustrating details of a 

demand for high-bandwidth image processing hardware, a 24-bit destacker unit and its operation, 

consequential decrease in system cost, and automatic FIG. 6 A is a schematic diagram illustrating details of a 

smoothing in the displayed image of pixel-to-adjacent-pixel first addends-choosing unit which may be coupled to the 

discontinuities. 65 MUXCAP unit of below-described FIG. 7, wherein the 

A structure in accordance with the invention comprises: addends-choosing unit includes a post-choice horizontal 

(a) a memory unit for storing low-resolution pixel data of and/or vertical interpolation enabling means which creates 



02/04/2003, EAST Version: 1.03.0002 



us 6,191, 

5 

an appearance that one or both of horizontal and vertical 
intcriralation functions has been selectively enabled or dis- 
abled. 

FIGS. 6B.1 and 6B.2 are diagrams explaining the func- 
tions of post-choice modifying units 640-643 of FIG. 6A- ^ 

FIG. 6C is a schematic diagram illustrating details of a 
second addends-choosing unit which may be coupled to the 
MUXCAP unit of below-described FIG. 7, wherein the 
addends-choosing unit includes a pre-choice a horizontal 
and/or vertical interpolation enabling means which creates 
an appearance that one or both of horizontal and vertical 
interpolation functions has been selectively enabled or dis- 
abled. 

FIGS. 6D,1 and 6D.2 are diagrams explaining the func- 
tions of subposition modifying units 1640-1643 of FIG. 6C. 

FIG. 7 is a schematic diagram of a MUXCAP unit of the 
invention. 

FIG. 8 is a schematic diagram illustrating details of a 
pipelined average-calculating mechanism in accordance 20 
with the invention. 

DETAILED DESCRIPTION 

Referring to FIG. 1, a block diagram of an image pro- 
cessing and display system 100 in accordance with the 25 
invention is shown. 

A key feature of system 100 is that it is relatively low in 
cost and yet it provides mechanisms for handling complex 
image scenes in real time and displaying them such that they 
appear to have relatively high resolution. ^ 

This feature is made possible by including a resolution- 
enhancing subsystem 150 on one or a few integrated circuit 
(IC) chips within the system 100. TTie operations of sub- 
system 150 are best understood by first considering tbe 
video processing operations of system 100 in an overview 
sense. 

FIG. 1 provides an overview of the system 100. Except 
where otherwise stated, all or most parts of system 100 are 
implemented on a single printed circuit board 99 and the ^ 
circuit components are defined within one or a plurality of 
integrated circuit (IC) chips mounted to the board 99. Except 
where otherwise stated, all or most of the circuitry is 
implemented in CMOS (complementary metal-oxide - 
semiconductor) technology using 0.9 micron line widths. An 
of^-board power supply (not shown) deUvers electrical 
power to the board 99. 

System 100 includes a video display driver 105A-105B, 
a real-time image-data processing unit (IPU) 110, a video 
random-access memory unit (VRAM) 120 having multiple 50 
independently-addressable storage banks, the aforemen- 
tioned resolution-enhancing subsystem 150 and a high- 
resolution video display unit 160. 

In the illustrated embodiment, VRAM 120 has two 
independently-addressable storage banks. A front-end por- 55 
tion 105A of the video display driver incorporates a low- 
resolution video pixel (LPx) clock generator 108 supplying 
periodic clock pulses to a dual-output video-address gen- 
erator (VAG) 115. The VAG 115 outputs two bank-address 
signals, ABq and ABj, to the mtilti-bank VRAM 120 in go 
response to a ptilse received from the LPx clock generator 
108. 

VRAM 120 outputs two pixel-defining "halfword" 
signals, Px(LRo) and Px(LRi), on respective VRAM ou^ut 
buses 122 and 121 to the resolution-enhancing subsystem 65 
150 in response to respective ones of the bank-address 
signals, ABq and ABj. 
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Hie resolution-enhancing subsystem ISO includes a 
cross-over unit 151 for selectively tran^osing the Px(LRo) 
and Px(LRi) signals; first and second delay registers, 156 
and 155 (A and B), coupled to the cross-over unit 151 for 
generating previous-column signals, Px(LRo, LC.^) and 
Px(LRj, LC_i); and an intcipolator 159 for generating 
high-resolution pixel signals, HPx(HRy, HC^j), in response to 
the previous-column signals, Px(LRo, LC_j) and Px(LRi, 
LC_j) and in response to current-column signals, Px(LRo, 
LC_o) and Px(LRi, LC_o), supplied from the cross-over unit 
151. The bus which connects the output of cross-over unit 
151 to the input of A-rcgister 156 is referred to as the A-side 
bus 154. The bus which connects the opposed output of 
cross-over unit 151 to the input of B-register 155 is referred 
to as the B-side bus 153. 

The high-resolution pixel signals, HPx(HRy, HCj,), pro- 
duced by interpolator 159 appear on output bus 15 9o and 
then pass by way of display-driver portion 105B to the video 
display unit 160. A high-resolution pixel clock generator 
(HPx CLK) 158, operating at twice the frequency of the LPx 
clock generator 108, drives the resolution-enhancing sub- 
system 130 such that high-resolution pixel signals HPx(HRy, 
HCjt) appear on output bus 159o at twice the rate that 
low-resolution pixels Px(LRo) and Px(LRj) appear on 
VRAM output buses 122 and 121. (InddentaUy, the video 
display unit 160 is located off board 99 and its circuitry can 
be implemented in technologies other than CMOS.) 

The abbreviation "LR" is used in the above paragraphs 
and throughout the remainder of this disclosure to represent 
"Low-resolution Row*'. The abbreviation "LC* is used 
throughout this disclosure to represent "Low-resolution Col- 
umn". Similarly the abbreviations "HR" and "HC are used 
throughout to respectively represent High-resolution Row 
and High-resolution Column. FIG. 2 shows the relation 
between low-resolution and high-resolution rows and col- 
umns. 

The subscript "0" is often times (but not always) used in 
this disclosure to indicate an even-numbered row. The 
subscript "1" is often times (but not always) used to indicate 
an odd-numbered row. The abbreviation "HPx" is used to 
represent High-resolution Pixel. 

The simple abbreviation "Px" is used to represent a 
low-resolution pixel. A reference such as Px(LRo, LC^t) 
therefore indicates a low-resolution pixel associated with an 
even-numbered low-resolution row, LRq, and low-resolution 
column numbered as, LCjj.. The abbreviation "LPx" is also 
used occasionally to represent a low-resolution pixel. 

A reference such as HPx(HRy, HC^ indicates a high- 
resolution pixel associated with a high-resolution row nimi- 
bered as HR^, and a high-resolution column numbered as 
LCjfc, where j and k refer to either odd or even integers. 

In the illustrated embodiment of FIG. 1, a human observer 
170 is shown viewing a high-resohition image 165 projected 
from (or onto) video display unit 160. Hie perceived per- 
formance and image resolution is referenced as 172. 

Display unit 160 is a VGA color monitor or an NTSC- 
compatiblc color television set, or a like display means (e.g., 
a Uquid crystal display panel) or a display means of better 
resolution which has the capacity to display a pixel matrix 
of at least, approximately 640-by-480 pixels resolution. The 
link 169 between board 99 and display tmit 160 can be 
provided through a baseband connection or by way of an RF 
modulator/demodulator pair. 

The image data processing unit (IPU) 110 is driven by a 
processor dock generator 102 (50.097896 MHz divided by 
one or two) operating in synchronism with, but at a higher 
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frequency than the LPx clock generator 108 (12.2727 MHz). (aFB's, not shown) storing low-resolution image data of 

IPU 110 includes a RISC type 25 MHz or 50 MHz ARM610 similar structure to that stored in the current firamc-buflFer 

microprocessor (not shown) available from Advanced RISC region (cFB) 125. A system variable is occasionally 

Machines Limited of Cambridge, U.K. A plurality of sprite- switched to designate one of these other regions as the 

rendering engines (not shown) and direct memory access 5 current frame-buffer, thereby providing a quick means for 

(DMA) hardware (not shown) are also provided within the changing the displayed image en masse. 

IPU 110. If desired, VRAM 120 can also store high-resolution 

The IPU 110 accesses binary-coded data (e.g., 125) stored image data (not shown) and the stored high-resolntion image 

within the VRAM 120 and modifies the stored data at a data can be transmitted as is to video display unit 160. 

sufficiently high-rate of speed to create the illusion for When low-resolution images are to be displayed, the front 

observer 170 that real-time animation is occurring in the end display driver 105A, which includes video-address 

high-resolution image 165 displayed on video display unit generator (VAG) 115 and low-resolution pixel clock gen- 

160. In many instances, observer 170 will be interactively erator 108, periodically fetches low-resolution formatted 

affecting the animated image 165 by operating buttons or a display data (e,g, at a rate of 60 fields a second when display 

joystick or other input means on a control panel 175 that 15 (jnver 105A-105B is operating in NTSC mode) from the 

feeds back signals 178 representing the observer's real-time system's current frame buffer region (CFB) 125. The fetched 

responses to the image data processing tmil (IPU) HO. data appears in 32-bit-wide parallel format on respective left 

IPU 110 is operatively coupled to the video random- and right data output buses 122 (even) and 121 (odd) of 

access memory (VRAM) 120 such that the IPU 110 has VRAM 120. 

read/write access to various control and image data struc- ^ Each of the fetched left and right halfwords, Px(LRq, LCj^) 
turcs stored within VRAM 120 either on a cycle-steal basis and Px(LRi, LCjj), is structured as shown at 126 to consist 
or on an independent access basis. For purposes of the of 16 bits. When an RGB color-system is employed, 5 of the 
disclosed invention, the internal structure of IPU 110 is 16 halfword bits define one out of 32 possible Red gun 
immaterial. Any means for loading and modifying the con- intensities, 5 of the bits define one out of 32 possible Green 
tents of VRAM 120 at sufficient speed to produce an ^ gun intensities, and 4 (or 5 depending on a selected inter- 
animated low-resolution image data structure 125 of the type polation mode) of the bits define one out of 16 (or 32 
described below will do. depending on mode) possible Blue gun intensities. (Aside: it 
The VRAM 120 has the capacity to store 1 megabyte of was found that the human eye is less sensitive to intensity 
data but it can be expanded to store 2 or 4 or 16 megabytes ^ variations at the blue end of the visible spectrum than to 
ofdata.(Abyteisunderstood to consist of eightbitsof data.) those at the red end, hence it is acceptable to provide less 
One to two megabytes of VRAM storage is preferred but not variance at the blue end when one of the 16 halfword bits is 
an absolute minimum or maximum storage requirement. The borrowed for other functions.) 

system will work with a VRAM of larger or smaller capacity When 4-bit blue mode is employed, the remaining 2 of the 
also. VRAM access time should be small enough to meet the 16 halfword bits are referred to as the vertical and horizontal 
demands of the low-resolution pixel video clock 108 and subposition bits, SP^ and SP^ They are used by a pixel 
processor clock 102. It is to be understood that VRAM 120 interpolating portion 159 of resolution-enhancing subsystem 
can be incorporated within a larger "system** memory that 150 for resolution expansion. Although the format of the 
includes DRAM and/or RAMBUS™ storage devices. In ciurent frame buffer (cFB) 125 is 320x240 pixels, it is 
such a case, VRAM 120 can serve as a cache area into which ^ possible to expand its image into a 640x480 pixels format by 
there is loaded image data that is to be then displayed or judiciously copying the shading value of each original pixel 
otherwise processed. in the 320x240 format (hereafter "low-resolution pixel") to 
The IPU UO reads and writes data from/into the VRAM a selected one of 4 corresponding pixel spaces in the 
120 in the form of 32-bit wide "words". Physically, the 640x480 format (hereafter "high -resolution pixel" or 
VRAM 120 is split into left and right independently addrcs- 45 "HPx"). The remaining three pixel spaces in the high- 
sable banks where each bank has its own 16-bit-wide resolution space are filled through the use of an interpolation 
address port and 16-bit wide data port. This gives hardware algorithm. TTie 2 subposition bits, SP^ and SPj^, of each 
devices, such the resolution-enhancing subsystem 150, l^-bit halfword control the one-out-of-four placement step, 
simultaneous access to two separately addressable 16-bit The SPjy subposition bit is positioned adjacent to the least 
"halfwords" within VRAM 120. In most instances, such as 50 significant bit of the 4-bit blue field. When 5-bit blue mode 
when the image data processing imil (IPU) 110 is accessing is employed, the SPj^ subposition bit is replaced by the least 
data within VRAM 120, the same address is applied to both significant bit of the 5-bit blue field. The remaining one of 
banks of the VRAM 120, and accordingly, the VRAM 120 the 16 halfword bits is still referred to as the vertical 
functions as a unitary 32-bit wide word-storing system. subposition bit, SPy, and it is used in a one-out-of-two 
When the resolution-enhancing subsystem 150 is fetching 55 placement step to control interpolation. The latter interpo- 
data out of VRAM 120, however, the lefl-bank address word lation algorithm will be described later, in conjunction with 
ABo (a 16-bit-wide signal) can be different from the right- FIG. 2. 

bank address word ABj (also a 1 6-bit-wide signal). They can A RAM (not shown in FIG. 1), which fimctions as a color 

also be the same when desired. look-up table (GLUT), may be inchided in system 100 to 

VRAM 120 is programmed to contain image-defining 60 convert the 5/5/4-bit-widc formatted RGB data of data 

data in a variety of VRAM address regions, including a stracturc 126 into 8/8/8-bit-wide formatted RGB data so as 

low-resolution, current frame-buffer region (cFB) 125. The to provide a 24 shading-bits-per pixel RGB format. For the 

VRAM 120 also contains image-rendering control data in sake of simplification, system 100 (FIG. 1) is assumed to not 

other regions (not shown) and instruction code for execution include a GLUT. A second system 400 of a later-discussed 

by the IPU 110 in yet other regions (not shown). In addition 65 FIG. 4A does include such a GLUT (451,452). 

to current frame-buffer region (cFB) 125, the VRAM 120 The invention is not restricted to RGB formats. Other 

will often contain one or more alternate frame-buffer regions digital formats such as YCC, or Composite Video Broadcast 
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Standard (CVBS), can also be used. For the sake of QA, QB, QC, and QD, arranged clockwise in the recited 

simplification, RGB format is assumed. order starting from the top left comer. The subposition bits. 

If the video display unit 160 requires an analog input, an SP^ and SP^ of each 16-bil halfword 126 (FIG. 1) point to 

output portion 105B of the display driver converts the output one of the four subposition regions, QA-QD, of a corre- 

of the resolution-enhancing subsystem 150 into NTSC or 5 sponding low-resolution pixel. (QA«=00, QBt=01, QC=10, 

PAL or Super- VHS or some other analog si^al format, and QD=11.) 

supplies the converted signal to the video display unit (TV ti,^ -inn- jTrn • . u j c 

monitor) 160. For the cSt of NTSC displayf each pair of "^^^"^^ ^00 m HG. 2 is to be viewed as further 

frames (a frame consists of two fields) is divided into four ^^TT.^^f, f^'^ equally-spaced high-resolution pixels 

interlaced fields (FIELDS 1, 2, 3 and 0). The four fields are ,^ ^} ^^^^ °° ^ second plane direcUy below the plane 

sequentially flashed to the eyes of a viewer 170 over time to low-resolution pixels (LPx's), The equal spacing of 

create the iUusion of animation. In some instances, the the high-resolution pixels 204 is somewhat distorted in FIG. 

viewer 170 may be wearing stereoscopic eyeglasses (e.g., ^ s*^^^ groups of four HPx's each associated with a 

Uquid crystal shutters) which alternatively block light from corresponding four subposition regions, QA-QD, of each 

reaching one or the other of the viewers left and right eyes low-resolution pixel. High-resolution pixels 204 are 

so as to create a three-dimensional effect. The stereoscopic depicted as dashed (hidden) circles in FIG. 2. 

image is appropriately distributed across FIELDS 0-1 and High-resolution pixels 204 are individually identified by 

2-3 for such instances. For the sake of simplicity, the two respective high-resolution row and column numbers, HR 

fields of a frame will be refened to as Fl and F2 throughout and HC. For the sake of simplified mapping, two numbering 

this disclosure. systems are used to define the placement of each HPx 204. 

Before the resolution-enhancing subsystem 150 is ^ In a so-called "decimated" numbering system, the high- 
described in more detail, a few simple observations can be resolution rows are numbered sequentially, starting from the 
made with regard to having data representing a low- top, as HR#0.0, HR#0.5, HR#1.0, HR#1.S, HR#2.0, 
resolution image 125 stored in VRAM 120 rather than a HR#2.5, HR#3.0, and so forth. In a so-called "non- 
high-resolution image 165. First, the storage capacity . decimated" numbering system, the same high -resolution 
demands placed on VRAM 120 are small in comparison to rows arc numbered sequentially, starting from the top, as 
those that would have been made if the current frame buffer HR#0, HR#1, HR#2, HR#3, HR#4, HR#5, HR#6, etc. To 
(cFB) 125 and the alternate frame buffers (aFB's, not convert from decimated to non-decimated, one simply mul- 
shown) had to store data representing an image of higher- tiplies the decimated value by two and removes the decimal 
resolution. Second, the image-processing bandwidth ^ poin* with any trailing zeroes. 

required from image data processing unit (IPU) HO is small A similar system is used for identifying the high- 

in comparison to what would have been required if the resolution columns sequentially, starting from the left, as 

current frame buffer 125 had to store a higher-resolution decimated column numbers HC#0.0, HC#0.5, HC#1.0, 

image. And third, the frequency at which the video pixel HC#1,5, HC#2.0, HC#2.5, HC#3.0, and so forth; or in the 

clock 108 operates is reduced and the number of cycles it non-decimated system as HC#0, HC^l, HC#2, HC#3, 

steals per second from the processor clock 102 (in cases HC#4, HC#5, HC#6, etc. The top leftmost high -resolution 

where cycle-steal is used) is also reduced. The overall pixel resides at HR#0.0, HC#0.0. 

benefit is reduced cost and speed pressures placed on the As seen in FIG. 2, low-resolution row LR#0 overlaps 
design of system 100. Observer 170 nonetheless perceives high-resolution rows HR#0.0 and HR#0.5, Low-resolution 
172 a high-resolution animated image 165 projected firom ^ column LC#0 overlaps high-resolution columns HC#0.0 and 
(or onto) video display unit 160. HC#0.5. And a similar one-to-two mapping exists between 
Referring to FIG. 2, the operation of the resolution- the remaining low-resolution row/columns and the high- 
enhancing subsystem 150 is first explained graphically. resolution rows/columns. 

Mapping 200 shows a plurality of low-resolution pixels Referring briefly to FIG. 1, it is to be understood that the 
(LPx's) 201 as large squares arranged in a regular matrix 45 color/shading codes of low-resolution pixels 201 residing in 
format on a first of two overlapping planes. The LPx's 201 the same LC but adjacent even and odd-numbered low- 
are arranged to define low-resolution rows LR#0, LR#1, resolution rows (LRq and LRj) of FIG. 2 are stored respec- 
LR#2, LR#3, etc. and low-resohition columns LC#0, LOfl, tivcly at same-addressed locations of the left and right banks 
LC#2, LC#3, etc. The top leftmost low-resolution pixel of VRAM region 125. Accordingly, when ABo=ABi (and 
resides at LR#0, LC#0. 5q they both point to region 125), the left bank-address signal 
A low-resolution row will typically have 40 or more ABq addresses the color/shading code of a low-resolution 
low-resolution pixels. The illustrated example assumes 320 pixel residing in an even-numbered rows, LR#0, LR#2, 
low-resolution pixels per low-resolution row, but this num- LR#4, etc. and the right bank-address signal AB^ addresses 
ber is not necessarily fixed. It is understood that a high- the color/shading code of a low-resolution pixel residing in 
resolution row will have a substantially larger number of 55 the next-adjacent odd-numbered row, LR#1, LR#3, LR#5, 
high-resolution pixels, for example, two or more times as etc. 

many as a low-resolution row. when region 125 of VRAM 120 is appropriately pro- 

Similarly, a low-resolution column will typically have 40 grammed as stated above, the left VRAM output bus 122 

or more low-resolution pixels. The ilhistrated example will produce pixel-defining data Px(LRo, LC;t.) representing 

assumes 240 low-resolution pixels per low-resolution eo a low-resolution pixel in column LC;^ and an even-numbered 

column, but this number is not necessarily fixed. It is row, LRq, while the right VRAM output bus 121 will 

understood tiiat a high-resolution column will have a sub- produce pixel-defining data Px(LRj, LCjj representing a 

stantially larger number of high-resolution pixels, for low-resohition pixel in the same column LCj^ but in the 

example, two or more times as many as a low-resolution next-adjoining odd-numbered row, LRj whenever equal 

col™n- 65 address signals (ABq^ABj) are applied to the left and right 

In FIG. 2, each low-resolution pixel (LPx) 201 is subdi- bank portions of VRAM 120 that contain even-row/odd-row 

vided into four equal-sized subposition regions (quadrants): parts of low-resolution image structure 125. If, on the other 
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hand, address signal ABq is advanced to point to the same an LR step in the vertical direction (y). The number of dme 

column but one row ahead of the Low-resolution pixel delay registers (155 and 156) would also have to be 

pointed to by address signal AB^, the left VRAM output bus increased for each window expansion in either the horizontal 

122 will produce pixel-defining data Px(LRo, LCj^ repre- direction (x) or vertical direction (y). The illustrated two 

scnting a low-resolution pixel in column iJCj^ but the next- 5 LR's by two LC's size of window 248 is preferred for 

adjacent even-numbered row, LRq, relative to the low- minimizing the number of VRAM banks and delay registers 

resolution pixel pointed to by address signal AB^. (155 and 156). 

FIG. 2 shows an interpolation window 248 surrounding Rather than performing the complex calculations of equa- 

the four low-resolution pixels 201 found at the intersection *ion Eq. la, a simplified average of N-choices calculation 

of rows LR#0, LR#1 and columns LC#1, LC#2. Interpola- 10 can be performed, as shown by the following equation Eq. 

tion window 248 is subdivided into top and bottom halves, 2, to approximate the results of Eq. la-l^ 
24Sa and 248^^ and also into left and right halves, 248^ and 

248c, respectively. The bottom half 2486 of interpolation ^ (Eg. 2) 

window 248 surrotmds the eight high-resolution pixels 204 Zj ^^^'^ 

found at the intersection of rows HR#1.0, HR#1.5, and 15 PENrc^^ = -!^^ 

columns HC#1.0, HC#1.5, HC#2.0, HC#2.5. (The four 
low-resolution pixels in interpolation window 248 will later 

be referred to as LPxO through LPx3.) In equation Eq. 2, for each value of i, the source-identifier, 

Four smaU squares respectively labeled S^, S„ S3, and S„ J®' t^X"" ''''^ ' ' ' 

are shown located in prespedfied subpositions of the low- ^ P^N^/X^ therefore each be equal to PEN^, m 

resolution pixels (LPx's) of window 248. Each small square, "^^^ ''^l^^^^-'^^f ^^.^^^^ """^^^ ""^^l 

S,^, represents the color and/or shading (e.g., a particular ^^^s, contributes 100% to the value of PEN^,^,,) 

mix of the RGB primaries) assigned to its corresponding ^J^^^^^^f^'^'^y* ^^'J ^'''^^ "^^f^^^ ^> ^ =Kl^' 

low-resolutionpixel.Thecolor/shadingof squaresS,^,are ^?^?^/<i?^^;°"^ ^^,f^^ ^^V^' 

respectively designated as "source pen" codes PEN, through ^ "^^^ PEN^/(*,,) through PEN^^-^^ are each set equal to 

p™ ^ J PEN^4, in which case PEN^^^^, takes on the value of 

^. ^ , . . ^ (k/N)*PENs2+(N-k/N)*PEN54. The amount of contribution 

The two center-most high-resolution pixels withm the ^^^^ ^^^^^ p^^ 

bottom half 2486 of window 248 are referenced as targets ^^^^^ ^^^^^ ^ ^ ^ 

T,, and T,2. The color/shadmg of targets T,i and T^ a^^ 30 Other combinations, using any others or all of 

each derived by applymg a distance-weighted mterpolaUon pen^-PEN,„ are also possible. A wide range of possible 

^ ^T^^i^' T approximauon thereof to the source pen contributions by each of PEN^,-PEN^, to the final value of 

codes, PEN, through PEN4 in ac<x)rdance with one of the pen^^ from 0% through 100%, can be selected, depend- 

followmg equations (Eq. la~b or 2): ^^^^^ ^^^^ PEN^.-PEN,, gets selected 

35 as one of contribution factors PEN^y^i^ through PEN^y^^. 

PENa Jic^ifi 1 ^ With an appropriate set of combinations, equation Eq. 2 can 

' " be made to approximate the results of Eq. la~lb. 

In the embodiment of FIG. 2, the interpolation window 
248 corresponds to a number of sources, N=4, and sixteen 

. t-.^ ^ ^ ^ possible target pixels. Although window 248 covers 16 

In equation Eq. 1, N is an integer greater than 1 (e.g., 2, 4, Mgh-resolution pixels (HPx's), shading does not have to be 

9, 16), d«r represents the distance from the center of source ^al^^^d for all possible targets (high-resohition pixels) 

square S, to the center of the target high-iesolutton pixel, Q ^^^^ ^ ^ ^^j^^^j embodiment 

represents a power (e.g., 1, 2, etc.) to which the d^tance is „^ ^„ j ^ calculated while the 

to be raised, c represente a zero-ofiset constant (e^ -1, 1 ^^^^ ^ g^, j^^^ ^^^^ m&c^Uid position (during 

0.5, 0.1, etc.) and PEN^, represents the color/shading of a so-called field Fl pass). Later, when the window slops over 

source square ^i- the indicated position for a second time (during a so-called 

From above equation Eq. la it is seen Aat contnbutions ^ ^ shading/coloring codes of two other 

from the N source squares are avwaged, and weighted centrally-located target pixels, T,, and are calculated 

according to distance, to determme the final color/shading generated 

(PEN^„^J of a target high-resolution pixel (T or T.J. A j^^^ interpolation completes for a given stop over low- 
source square S, sittmg direcUy over the target pixel con- resolution rows LR#1 and LR#2 (and the shading/color of 
tributes the most because distance d^ is zero. A source ^^^^ ^^^^ ^ , determined), the interpo- 
square S, located furthest from the target pixel contributes ^^^^^ ^^^^ ^48 steps to the right by one low-resolution 
the least. In one embodiment, c«D, Q«2, and m cases where ^j^^ and interpolation begins for determining the 
d^,^, the above equation Eq. la is replaced by: shading/color of one or more additional target pixels (T.,) in 
PEN PEN fEq 16) Corresponding intersection of high-resolution rows 

HR#0.0-HR#1.5 with high-resolution columns 

It is also seen from the above equations (Eq. la and Eq, HC#2.0-HC#3.5). 

lb) that the invention is not limited to an interpolation 60 Preferably, at least two high-resolution target pijcels (e.g., 

window (248) of any specific size or shape. The interpola- T^j and Tjj) should be calculated and generated by inter- 

tion window (248) can be expanded in the horizontal direc- polator 159 per window stop. This approach allows inter- 

tion (x) or vertical direction (y) or both by respective steps polation to be carried out on the fly as the video-address 

of one or more low-resolution columns and low-resolution generator (\^G) 115 of FIG. 1 scans across the pixels of a 

rows if so desired. The number of independently- 65 low-resolution row in source image 125 in synchronism with 

addressable banks in multi-bank VRAM 120 should be the LPx clock generator 108 and display driver end-portion 

increased by one with each expansion of the window size by 105B outputs the color/shade/illumination-defining signals 



PENr. 
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for two or more corresponding higb-resohition pixels in a AB^ and AB^, pointing to memory locations one row apart, 
high-resolution row of target image 165 in synchronism with When window 248 overlaps low-resolution rows LR#0 and 
the HPx clock generator 158. LR#1, ABooABj. When window 248 overlaps low- 
As indicated in FIG. 2, rows HR#1.0, HR#2.0, HR#3.0, resolution rows LR#1 and LR#2, ABo=ABi+L^^ where 
etc. are associated with interlaced field Fl. Rows HR#0.5, 5 is an ofi^t for moving one low-resolution row forward 
HR#1.5»HR#2.5y etc. are associated with interlaced field F2. in the address space of memory. \^deo-address generator 
While field Fl is being output to the video display unit 160, (VAG) 115 is appropriately switched to generate the neces- 
window 248 steps rightward across low-resolution rows sary stream of equal or nonequalABo and AB^ bank address 
LR#0 and LR#1, writing out target positions Tji and Tjj signals. 

within the window as the codes for high-resolution row lo FIGS. 3A through 3E show one possible set of contribu- 

HR#1.0. (Aside: In the later described embodiments of tion weightings whidi can be used within interpolator 159 to 

FIGS. 6A and 6C horizontal interpolation can be selectively determine what contribution a source square S,- within an 

turned on or off. When horizontal interpolation is turned off interpolation window is to make to a target pixel in accor- 

(HIONsO) in a first embodiment (FIG. 6A), the code written dance with equation £q lo. 

out for target positions Tjj and ^he same. When 15 Referring to FIG. 3A, the distance between quadrant QD 

horizontal interpolation is turned off (HION«0) in the sec- and target pixel Tji of the same low-resolution pixel is 

ond embodiment (HG. 6C), the code written out for target defined as one unit. The distance between quadrant QB and 

positions and Tj2 is adjxisted in a more complex way to target pixel T21 of the same low-resolution pixel is therefore 

give the appearance that horizontal interpolation is not also equal to one unit. Hie distance between quadrant QA 

taking place.) 20 and target pixel T21 of the same low-resolution pixel then 

When window 248 reaches the end of rows LR#0 and becomes equal to the square root of two units. Source to 

LR#1, it steps down by one low-resolution row, returns to target pixel T21 distances (d^.,^) for further parts of the 

the left edge and scans rightward across low-resolution rows interpolation window are calculated accordingly. 

LR#1 and LR#2, again writing out target positions and FIG. 3B maps the V^scr contribution weights for target 

Tj 2 within the window as the codes for high-resolution row 25 pixel Tji- FIGS. 3C-3E map the V^scr contribution 

HR#2.0. This process repeats for high-resolution rows weights for respective target pixels T22, Tj^, and Tjj. 

HR#3.0, HR#4.0, etc., until field Fl completes. Note that the contribution weights are all equal to or 

Ihen window 248 returns to the top left of mapping 200 approximately equal to multiples of 0.25, More specifically: 

and repeats the process, this time writing out target positions 1.00=4*(0.25), 0.50 2*(0.25), 0.25=1*(0.25), 0,20 is 

T21 and T22 within the window as the codes for high- 30 approximately equal to 1*(0.25), and 0.125 is approximately 

resolution rows HR#0.5, HR#1.5, HR#2.5, etc. (Aside: In equal to 1*(0.25) or 0'(0.25), depending on the relative 

the later described embodiments of FIGS. 6 A and 6C contributions of other source squares. These combinations 

vertical interpolation can be selectively turned on or off. can be produced by equation Eq. 2 when N is set to four. 

When vertical interpolation is turned off (VION^O) in a first Division by four, in order to obtain an average after four 

embodiment (FIG. 6 A), the code written out for target 35 contributors are selected and added, can be easily imple- 

positions T^y and T22 is the same as that written for target mented for binary-coded values by a shift right of two bit 

positions T^j and T^j. When vertical interpolation is turned positions. 

off (VIONoO) in the second embodiment (FIG. 6C), the Note also that the transform maps of FIGS. 3B-3E are 

codes written out for reject target positions Tii/Tsj and mirror image copies of one another. 

^11^12 is adjusted in a more complex way to give the 40 In one embodiment of the invention, a single combina- 

appearance that-vertical interpolation is not taking place,) torial logic unit (320 of FIG. 3F, 620 of FIG. 6A) provides 

With regard to boundary conditions, the top most high- the transform fimction of FIG. 3C, as approximated by 

resolution row HR#0.0 and left-side high-resolution column equation Eq. 2. The single combinatorial logic unit (320, 

HC#0.0 are not actually displayed. As a consequence, their 620) selects four choices from the set, PEN^^ through 

contents do not have to be generated by the interpolator 159. 45 PEN54, and outputs four 2-bit-wide signals, B0-B3, each 

Note that the two targets, T21 and T221 for the field F2 representing one of the four choices. (The 2-bit "choice" 

rows are disposed within window 248 in mirror image signal is to be distinguished from the PEN code it points to. 

opposition to targets, T^ and Tjj. The algorithm used for The PEN code typically has many more bits, fifteen for 

generating the interpolated codes for targets, T21 and T22, is example.) 

preferably a mirror transform of the algorithm used for 50 If the target high-resolution pixel is other than the one 

generating the interpolated codes for targets, T^^ and T12. shaded in FIG. 3C, a forward/backward mapping scheme is 

Note also that each downward step taken by window 248, used to first transform the subposition coordinates of the 

from where it overlaps rows LR#0 and LR#1 to where it corresponding one of FIGS. 3B, 3D and 3E into the coor- 

overlaps rows LR#1 and LR#2 for example, involves an dinates of FIG. 3C; and after combinatorial logic unit (320, 

alternation between having an even-numbered low- 55 620) ou^uts the four choice signals, B0-B3, to transform 

resolution row (e.g. LR#0) under the top half 248fl of the those choices into their equivalents for the corresponding 

window and having an odd-numbered low-resolution row one of FIGS. 3B, 3D and 3E. 

(e.g. LR#1) under the top half 248a of the window. Cross- Referring to FIG. 3B, note that the weighting factors table 

over unit 151 (FIG. 1) is operated to place the appropriate of this FIG. 3B is also designated as the XY«00 table. X=0 

even or odd-numbered pixel signal LPx(LRo, . . . ) or 60 represents an even numbered di^lay field while X=l rep- 

LPx(LR J, . . . ) on the respective A-side bus 154 and B-side resents an odd numbered display field. YoO represents a first 

bus 153 of resolution-enhancing subsystem 150. table orientation for a given display field and Y=l represents 

Note further that each downward step taken by window a second table orientation. The tables of FIGS. 3C, 3D and 

248, from where it overlaps rows LR#0 and LR#1 to where 3E are respectively referenced as XY=01, XY=11 and 

it overlaps rows LR#1 and LR#2 for example, involves an 65 XYolO. 

alternation between having bank address signals, ABq and FIG. 3F illustrates a choice-making system 300 com- 

AB,, equal to one another and having bank address signals, prised of a 4-by-4 forward-mapping table unit (FMT) 310, 
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a 4-of-4 choice-making tabic unit 320, and a 4-by-4 
backwaid-mapping tabic unit (BMT) 330. The choice- 
making table unit 320 is structured to dioose four unique or 
duplicate items, B0-B3, from the set, PEN^ through PENj4, 
approximately in accordance with the weightings suggested 
by BG. 3C. 

The internal operations of choice-making table unit 320 
arc detailed at the end of this disclosure by Code-conversion 
Tabic 1 (This same codc-convcrsion table also describes the 
operations of later mentioned units 620 and 1620, and hence 
it is provided at the end of the disclosure.) Referring 
momentarily to Code-conversion Table 1, it is understood 
that the 2-bit wide input signal, AO, consists of less signifi- 
cant bit AOO and more significant bit AOl, Similarly, the 
2-bit wide output signal, BO, consists of less significant bit 
BOO and more significant bit BOl. 

Referring back to FIG. 2, each of quadrants QA through 
QD is associated with a corresponding 2-bit-wide subposi- 
tion value (CO, 01, 10, 11). The assignment of values is 
shown at 301 in FIG. 3F. Each of quadrants QA through QD 
has a horizontal bit value SPjy«0 or 1 and a vertical bit value 
SPv^O or 1. The (SPV, SPH) coordinates arc QA«(0,0), 
QBK0,1), QCK1,1) and QDKl.O). 

In FIG. 3F, four 2-bit wide signals, SPq through SP3 are 
provided, each representing an interpolation weighting coef- 
ficient (or "subposition point'*) that is assigned to a corre- 
sponding one of the four low-resolution pixels, LPxO 
through LPx3, then residing in the interpolation window 
248. This provides the choice-making table unit 320 with a 
total of eight bits of input information (AO through A3) 
which it may use to produce a corresponding set of four 
choices (BO through B3), each 2-bits wide. The choices are 
preferably arranged as set forth in code-conversion Table 1 
to cause above equation Eq. 2 to approximate the weightings 
suggested by FIG. 3C. 

FIG. 3F accordingly shows the choice-making table unit 
320 receiving four input signals: AO, Al, A2, A3, each 
two-bits wide, and outputting four choice signals: BO, Bl, 
B2, B3, each two-bits wide. 

Forward-mapping table unit (FMT) 310 operates the same 
for each of low-resolution pixels LPxO through LPx3. Mul- 
tiplexer 305 supplies each of the corresponding four sub- 
position coordinate signals, SPq through SP3, one al a time 
to forward-mapping table unit (FMT) 310 for each step of 
interpolation window 248. 

It is seen that for each XY target configuration and 
supplied set of subposilion coordinate values (SP^^ SP^^) for 
one of respective low-resolution pixels LPxO, through LPx3, 
there is a corresponding set of universal, UV position values 
inside the boxes of forward-mapping table unit (FMT) 310. 
For target configuration XY«0O, for example, subposition 
value 01 becomes UV position 00, subposition 10 becomes 
UV position 01, subposition 00 becomes UV position 11, 
and subposition 11 becomes UV position 10. For target 
configuration XY«01, the conversion is one-to-one. This is 
why the choice-making table unit 320 was earlier described 
as making its choices approximately in accordance with the 
weightings suggested by FIG. 3C 

Demultiplexer 315 converts the one-low-resolution pixel 
at-a-time output of forward-mapping table unit (FMT) 310 
to the four input signals: AO, Al, A2, A3, of choice -making 
table unit 320, If desired, the forward-mapping table unit 
(FMT) 310 can be duplicated four times and multiplexer 305 
and demultiplexer 315 can then be eliminated from FIG. 3F. 

Once the four output choice signals: BO, Bl, B2, B3, have 
been generated, the backward-mapping table unit (BMT) 
330 converts the choices to conform with any one of 
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high-resolution target states: XY=00orXY=01 orXY=ll or 
XY=10. Multiplexer 325 supplies each of signals B0-B3, 
one at a time to backward-mapping table unit (BMT) 330 for 
conversion. Demultiplexer 335 converts the one-choice al-a- 
time output of badcward-mapping table unit (BMT) 330 to 
the four appropriately-converted output choice signals: CO, 
CI, C2, C3, of choice-making table imit 320. If desired, the 
backward-mapping table unit (BMT^ 330 can be duplicated 
four times and multiplexer 325 and demultiplexer 335 can 
then be eliminated from FIG. 3F. 

Referring to the backward-mapping table unit (BMT^ 
330, it is seen that for each one-of-four choice (B0-B3) 
made by choice-making table unit 320, there are four 
possible target configurations. For target configuration 
XY«00, for example, universal l-of-4 choice 00 becomes 
converted choice Cx«ll (x represents one of digits 0 to 3 
here), universal l-of-4 choice 01 becomes converted choice 
Cx=00, universal l-of-4 choice 11 becomes converted 
choice Cx«10, and universal l-of-4 choice 10 becomes 
converted choice Cx=01. For target configuration XY=01, 
the conversion is one-to-one. 

A second embodiment in accordance with the invention 
which takes advantage of these factors will now be 
descnbed with reference to combined FIGS, 4 A and 4B. 

FIGS. 4A and 4B form a blodc diagram of a second 
imaging system 400 which includes a pipelined resolution- 
enhancing subsystem 450 in accordance with the invention. 
Like reference symbols in the "400" number series are used 
where possible for elements of FIGS. 4A, 4B which corre- 
spond to but are not necessarily the same as those in the 
"100** series within FIG. 1, 

In imaging system 400, a VRAM (Video-speed Random 
Access Memory) is provided in the form of left and right 
memory banks 420L and 420R. Each of left and right banks 
420L and 420R stores 2* datawords, A single dataword is 
16-bits wide. Left and right memory banks 420L and 420R 
are collectively referred to as VRAM 420. 

It is to be understood that imaging system 400 can include 
other, slower forms of data storage such DRAM and/or 
RAMBUS''*' storage devices that are operatively coupled to 
transfer data to and from VRAM 420. As such, VRAM 420 
should be considered as a cache-like area of system memory 
into which there is loaded image data that is to be then 
displayed or otherwise processed. 

A page -mode SRAM device such as the Toshiba 
TC524256AJ/AZ-12™ is preferred for forming VRAM 
banks 420L and 420R. The Toshiba device is a two-port 
static-random-access memory device in which one of the 
ports, a so-called "serial input/output" port (SIC), outputs a 
sequential stream of data words beginning with one stored in 
an address loaded into a serial address counter (S-CNT). The 
serial address counter (S-CNT) is clocked by a serial clock 
(SC) signal applied to the device from clock generator. 

The NEC uPD482234™ fast-page VRAM and NEC 
UPD482235'™ hyper-page VRAM are examples of other 
integrated circuit memory chips that support serial-mode 
data input and output. 

In the illustrated embodiment of FIG. 4A, respective left 
and right clock generators, 408L and 408R, are separately 
coupled to the serial clock input terminals of VRAM banks 
420L and 420R. Each of clock generators, 408L and 408R, 
operates at 6,13635 MHz, but the signals are provided out of 
60 phase to provide a combined frequency of 12.2727 MHz. 
Left and right clock generators 408L and 408R are synchro- 
nized to a shared video reference clock signal, CV25M, 
which operates at 24.5454 MHz. 

FIG. 4C shows the corre^onding signals, LSC\ (inverted 
65 left serial clock) and RSCv (inverted right serial clock). They 
arc derived from the 24.5454 MHz video reference clock, 
CV25M. 
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The serial input/output port (SIO) of the Toshiba 
TC524256AJyAZ-12™ is tri-slatcable and goes into a high- 
impedance state (Hi-Z) when a low serial-output enable 
(SOE) signal is applied to the device. This feature is used 
advantageously in system 400 to multiplex the SIO ou^uts 
of the left and right VRAM banks, 420L and 420R, over time 
onto upper and lower halves of a soon-to-be described S-bus 
423. 

Each Toshiba SRAM device has a second so-called "data 
input/output" port (DIO) which outputs datawords one at a 
time in accordance with a D-port address stored in another 
register (not shown) of the device. As seen, the 16-bit-wide 
DIO ports of VRAM banks 420L and 420R combine at the 
data input/ou^ut port (D) of CPU 410 to define a unitary 
32-bit-widc data word for purposes of image data process- 
ing. The right VRAM bank 420R stores bits 0 through 15 
and the left VRAM bank 420L stores bits 16 through 31. 

FIG. 4A shows a memory address manipulator chip 
(MAMC) 415 supplying respective left and right address 
signals, LA and RA (each 9-bits wide), to the address input 
ports of left and right VRAM banks 420L and 420R. The 
MAMC 415 also applies respective left and right control 
signals, L-CTL and R-CTL, to control input ports of left and 
right VRAM banks 420L and 420R. Independent SOE 
signals are included within the L-CTL and R-CTL control 
signals supplied to each of VRAM banks 420L and 420R. 
These are respectively designated as L-SOE and R-SOE. 

The 16-bit-wide SIO port 422 of left VRAM bank 420L 
connects to an upper 16-bit-portion, S(31:16) of a 32-bit- 
wide S-bus 423. The 16-bit-wide SIO port 421 of right 
VRAM bank 420R connects to a lower 16-bit-portion, 
S(15:0) of the same 32-bit-wide S-bus 423. The outputs of 
left and right SIO ports 422 and 421 are time-multiplexed 
onto the S-bus 423 in synchronism with the 24.5454 MHz 
clock, CV25M, as shown in FIG. 4C. 

Referring to FIG. 4C, the waveforms of signals, CV25M, 
LSCV, RSC\, S(31:16) and S(15:0) are shown in time align- 
ment at the top of FIG. 4C. Valid data states on S-bus 
portions, S(31:16) and S(15:0), arc denoted as "V* and "D", 
where represents valid Video datawords and "D" rep- 
resents valid instances of so-called slip-stream data. FIG. 4A 
shows a 24-bit wide slipstream data source 424 also coupled 
to S-bus 423. The slipstream data source 424 has tristatable 
output lines so that its signals can be time-m\iltiplexed onto 
the S-bus 423 with the VRAM SIO signals 421 and 422. 

Note that in FIG. 4C there are two instances of valid 
slip-stream data between each valid video dataword on each 
of S-bus portions, S(31:16) and S(15:0). The 24-bit wide 
"D" dataword is subdivided into a first, 16-bit wide, less- 
significant portion followed by a second, 8-bit wide, more- 
significant portion. When the 8-bit wide, more-significant 
portion of the slipstream data is output, the remaining 8 lines 
of the upper or lower S-bus portion carry don't care bits. 

Note further that the "V datawords of S-bus portions, 
S(31:16) and S(15:0) are non-overlapping. "V* and "D" 
datawords are introduced serially into the resolution enhanc- 
ing subsystem 450 and processed in pipelined fashion there- 
after. 

Note, moreover, that the "V" datawords of upper S-bus 
portion S(31:16) become valid on that bus portion a short 
time delay after respective falling edges of dock signal 
LSCV. The "V" words of lower S-bus portion S(15:0) 
become valid on that bus portion a short time delay after 
respective falling edges of clock signal RSC\. 

Hie left edge of FIG. 4C represents the end of a horizontal 
blanking interval. The first two active high or low states of 
a tri-statable ADOUT signal at the bottom of FIG. 4C 
represent the first 24-bit-wide pixel of a high-resolution 
video line. 
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During the horizontal blanking interval (left of the left 
edge of FIG. 4C), both the LSO and RSa signals are held 
high. As the horizontal blanking interval comes to an end, 
one of the LSC\ and RSCV signals goes active low before the 
5 other. 

FIG. 4C shows LSC\ becoming active low first. It is to be 
understood, however, that RSC\ could have been the one to 
become active low first. Control signals (not shown) from 
the memory address manipulator chip (MAMC) 415 detcr- 
mine which of clock generators 408L and 408R turns on first 
at the end of each horizontal blanking interval. This deter- 
mination produces an effect similar to the function of 
cross-over unit 151 (FIG. 1), except that signal cross-over 
switching is now done by way of time-domain multiplexing 
in pipeline fashion rather than spatially. It will be seen later 

15 that the time-ordered presentation of the LSC\ and RSC\ 
signals works to place an appropriate even or odd-numbered 
pixel signal LPx^Rq, . . . ) or LPx(LRp . . . ) on a respective 
A-side or B-side (e.g. CLUT banks 451 and 452 or left and 
right outputs of destackcr 455) of circuitry further down the 

20 line in the resolution-enhancing subsystem 450. 

S-bus 423 crosses an inter-chip boundary demarcated by 
a dash-dot line at the bottom of FIG. 4Aand top of FIG. 4B. 
Left and right serial clock signals, LSC and RSC, also cross 
the inter-chip boundary. The circuitry of a so-called 

25 CLUTUNTNOUT chip 430 (CLIO for short) begins below 
the dash-dot line. 

An S-Bus capture -control unit 431 is provided within 
CLIO chip 430 for controlling a set of S-Bus capture 
registers, 432-439,and capture -reordering multiplexers, 

30 441-443. The set of registers 432-439 have inputs coupled 
to both upper and lower portions of S-bus 423 for picking off 
the left and right "V" signals that are time-multiplexed onto 
S-bus 423. A set of "CAPCLK" (capture clock) signals 
strobe the S-bus capture registers 432-439, causing them to 

35 capture the appropriate time-multiplexed signals from the 
S-bus 423 at the appropriate points in time. A set of 
"CAPSW" (capture switching) signals control the capture- 
reordering multiplexers, 441-443, causing them to output 
appropriate time-multiplexed signals fi-om the capture reg- 

40 isters 432-439 onto respective multiplexer output busses 
441o (15-bits wide), 442o (2-bits wide), and 443o (24-bils 
wide), at the appropriate points in time. A specific embodi- 
ment 1431 for forming S-Bus capture-control unit 431 and 
capture registers 432-439 and capture-reordering 

45 multiplexers, 441-443, will be described later in conjunction 
with FIG. 4D. 

Still referring to FIG. 4B, reordering multiplexer 441 has 
two 15-bit-wide inputs respectively coupled to the outputs of 
a 15-bit-wide LRGB-capture register 432 and a 15 -bit-wide 

50 HRGB-capture register 433. LRGB-capture register 432 
captures a 15-bit wide RGB video ("V*') signal that is 
presented at various times on a lower portion (bits 15:00) of 
S-bus 423. HRGB-capture register 433 captures a 15-bit 
wide RGB video ("V) signal that is presented at various 

55 times on an upper portion (bits 31:16) of S-bus 423. The 
15-bit-wide output 441o of mxiltiplexer 441 produces a 
15-bit-wide serial stream of RGB signals corresponding to 
those alternately presented on the upper or lower portions of 
S-bus 423. ("RGB" video-signals presented on one of the 

60 upper and lower portions of S-bus 423 are deemed as those 
belonging to a "previous" low-resolution row and "RGB" 
video-signals presented on the other of the S-bus portions 
are deemed as those belonging to a "current" low-resolution 
row. The output order on bus 441o is previous first, then 

65 current, then previous, then current, and so forth.) 

Reorder multiplexer 442 has two 2-bit-widc inputs 
respectively coupled to the outputs of a 2-bil-wide LSP- 
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capture register 434 and a 2-bit-wide HSP-capture register 
435. LSP-c^turc register 434 captures a onc-or-two bit 
wide "subposition" ("S^*) signal that is presented at various 
times on the lower portion (bits 15:00) of S-bus 423. 
HSP-capture register 435 captures a one-or-two bit wide 5 
"subposition** ("SP") signal that is presented at various times 
on the upper portion (bits 31:16) of S-bus 423. The 2-bit- 
wide output 442o of multiplexer 442 produces a 2-bit-wide 
serial stream of SP signals corrcspondiiig to those alternately 
presented on the upper or lower portions of S-bus 423. lo 
(SP-signals presented on one of the upper and lower portions 
of S-bus 423 are deemed as those belonging to a "previous" 
low-resolution row and SP-signals presented on the other of 
the S-bus portions are deemed as those belonging to a 
"current" low-resolution row. The output order on bus 442o 15 
is previous first, then current, then previous, then current, 
and so forth.) 

The RGB and SP output signals of reorder multiplexers 
441 and 442 are derived from the 16-bit-wide data structure 
126 shown in FIG. 1. When 4-bit blue mode is employed, the 20 
least significant bit in the 5-bit-wide Blue gun field is forced 
to zero by circuitry within multiplexer 441 (not shown) and 
the remaining 2 of the 16 halfword bits on one of the S-bus 
upper and lower halves then serve as the vertical and 
horizontal subposition bits, SP^ and SPjy, that are oiitput by 25 
reorder multiplexer 442. When 5-bit blue mode is employed, 
one of the vertical and horizontal subposition bits, SPv and 
SP^, is forced to zero by circuitry within multiplexer 442 
(not shown) and the remaining 15 of the 16 halfword bits on 
one of the S-bus upper and lower halves then serve as the 30 
15 -bit-wide RGB signals that pass through reorder multi- 
plexer 441. 

Reordering multiplexer 443 has two 24-bit-wide inputs 
respectively coupled to the outputs of a 24-bit-wide LSS- 
capture(2) register 438 and a 24-bit-wide HSS-capture(2) 35 
register 439. A 16-bit wide LSS-capture register(l) 436 first 
captures, on a first tick of the video reference clock signal, 
CV25M (24.5454 MHz), a 16-bit wide, less-significant 
portion of a "slip-stream" (SS) signal that is presented on the 
lower portion (bits 15:00) of S-bus 423. The 24-bit-wide 40 
LSS-capture(2) register 438 next captures, on a second tick 
of video reference clock signal, CV25M, an 8 -bit wide, 
more-significant portion of the slip-stream (SS) signal that is 
then present on the lower portion (bits 15:00) of S-bus 423 
plus the previously captured 16-bits now output by register 45 
436. 

Similarly, a 16-bit wide HSS-capture register(l) 437 first 
captures, on a first tick of the video reference clock signal, 
CV25M, a 16-bit wide, less-significant portion of a "slip- 
stream" (SS) signal that is presented on the upper portion so 
(bits 31:16) of S-bus 423. The 24-bit-wide HSS-capture(2) 
register 439 next captures, on a second tick of video refer- 
ence clock signal, CV25M, an 8-bit wide, more-significant 
portion of the slip-stream (SS) signal that is then present on 
the upper portion (bits 31:16) of S-bus 423 plus the previ- 55 
ously captured 16-bits now output by register 437. The 
24-bit-wide output 443o of multiplexer 443 produces a 
24-bit-wide serial stream of SS signals corresponding to 
those alternately presented on the upper or lower portions of 
S-bus 423. 60 

The S-bus control circuit 431 also produces a previous/ 
current designating signal 446 for designating signals 
streaming down multiplexer ou^ut bus 441o as belonging 
either to a previous or current low-resolution row. In one 
embodiment, the previous/current designating signal 446 is 65 
formed by clocking a Toggle-type flip flop with the video 
reference clock signal CV25M (24,5454 MHz). The Toggle- 
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type flip flop (not shown) is reset before the start of a scan 
through a current low-resolution row. The delay between the 
reset time and the time of start of a corresponding stream of 
data down bus 441o is adjusted such that the first data item 
is deemed "previous". 

The output 441o of capture-reordering multiplexer 441 
connects to an input of a 15-bit-wide demultiplexer 445. 
Demultiplexer 445 has two 15 -bit-wide output buses, 445a 
and 445b, respectively coupled to the address inputs of two 
color look-up table units (memory banks). Demultiplexer 
445 responds to the previous/current line-of-origin desig- 
nating signal 446 provided to a control terminal thereof from 
the S-bus control unit 431 and routes the signals at its input 
(441o) to one or the other of the two color look-up table units 
in accordance with the "previous" versus "current" line-of- 
origin designation provided by the line-of-origin designating 
signal 446. 

The two color look-up table units are referred to as the 
A-CLUT 451 (current low-resolution video line color 
palette) and the B-CLUT 452 (previous low-resolution video 
line color palette). 

A GLUT bypass bus 447 is also provided for carrying the 
15-bit wide output 441o of captiire-reordering multiplexer 
441 to a CLUT-bypass unit 448. The function of unit 448 is 
explained later below. 

The A-CLUT 451 is a multi-port random access memory 
device (RAM) which has three independent address input 
ports (AI's, each 5-bits wide) for receiving compressed 
15-bit RGB signals. The 15-bit wide RGB signal is com- 
posed of 5 bits of R (e.g.. Red intensity) data, 5 bits of G 
(e.g.. Green intensity) data, and 5 bits of B (e.g.. Blue 
intensity) data which are respectively applied to the three AI 
ports of the A-CLUT 451. 

The A-CLUT 451 further has three corresponding data 
output ports (DO's) for outputting 24-bit-wide decom- 
pressed RGB datawords 45 lo associated with addresses 
supphed at the Al's. The 24-bit wide RGB output signal 
451o is composed of 8 bits of R (e.g.. Red intensity) data, 8 
bits of G (e.g,, Green intensity) data, and 8 bits of B (e.g., 
Blue intensity) data which are respectively output from the 
three DO ports of the A-CLUT 451. 

The A-CLUT 451 also has a serial data input port (SDI) 
for receiving data which is downloaded into the A-CLUT 
451 during each horizontal blanking interval. Color-palette 
conversion data for converting each 5-bit-wide color/ 
shading code of the RGB domain into an 8-bit-wide color/ 
shading code (in the RGB domain) is down-loaded from the 
VRAM (420L and/or 420R) through the SDI data-input port 
of the A-side CLUT 451 at the end of each line-display 
period (during the horizontal blanking period). Old data 
within A-CLUT 451 shifts out to load B-CLUT 452 during 
this process. The "current" video line palette thereby 
becomes the "previous" video line palette as processing of 
the current video line completes. This is required for proper 
interpolation if interpolation is to use CLUT-converted pen 
values. 

In addition to downloading new CLUT data, the horizon- 
tal blanking interval is also used for downloading new mode 
and path-control signals into the CLIO chip 430 such that the 
chip can switch its operating mode for each new line of 
video data. 

Each of the three sections within A-CLUT 451 stores at 
least 32 datawords, each 8-bits wide. Demultiplexer output 
bus 44Sfl is divided into three 5-bit-wide parts which respec- 
tively connect to the three Al's of the A-CLUT 451. Each 
5-bit-wide AI signal converts to an 8-bit-wide as it passes 
through A-CLUT 451. The combined 24-bit-wide output of 
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A-CLUT 451 connects to a 24-bit-wide input port 453a of 
a subsequent multiplexer 453. 

B-CLUT 452 is similarly stnictuied to convert the 15-bit- 
wide signal on demultiplexer output bus 44Sb into a 24-bit- 
wide RGB output signal 452o that is supplied to another 5 
24-bit-wide input port 453b of subsequent multiplexer 433. 

In a second embodiment in accordance with the invention 
(not shown), A-CLUT 451 and B-CLUT 452 are software- 
defined parts distributed across three SRAM's. Each of these 
SRAM's (not shown) has its own 7-bit-wide, independent 
address input port (AI), and stores 66 bytes. The 66 bytes are 
divided into a first bank of 33 bytes and a second bank of 33 
bytes. Five of the bits in the 7-bit address field receive the 
5 R or G or B bits as above and they select one of the first 
32 bytes in cither the first bank or the second bank. A sixth 
bit in the 7-bit address field acts as the bank-select bit 1^ 
(previous/current designating bit 446). It replaces the func- 
tions of demultiplexer 445 and multiplexer 453. Hie seventh 
address input bit defines a background-mode bit. It is used 
to override the selection of the first five address bits and 
instead output the thirty-third (33rd) byte of the selected 20 
bank as a "backgrouDd** color. (While various embodiments 
of the CLUT arc under consideration, it is to be noted that 
RGB is not the only way to implement the invention. As an 
alternative to storing RGB formatted data, the CLUT SRAM 
could store data in YCC format or any other desired format.) 25 

CLUT-bypass unit 448 is used if color conversion is to be 
bypassed. Color conversion can be bypassed on a line-byline 
basis. The connects to CLUT-bypass unit 448 converts the 
15-bit-wide RGB signals of multiplexer output bus 441o 
into 24-bit-wide RGB signals by padding three zero bits or 30 
other data into each of the R, G and B fields, thereby 
converting the 5-bit-wide original fields into 8-bil-wide 
fields. In one embodiment, the received 5-bits of R or G or 
B intensity fill the 5 MSB's (most significant bits) of each 
8-bit-wide output generated by the CLUT-bypass unit 448'. 35 
The 3 LSB's (least significant bits) of each 8-bit-wide output 
are selectively forced equal to either (a) zero, or (b) the same 
value as that of the 3 MSB's, or (c) a 3-bit value produced 
by a pseudo -random number generator (not shown). The 
latter option produces an eye soothing color dither when an 40 
appropriate pseudo-random function is chosen. 

Hie previous/current designating signal 446 controls mul- 
tiplexer 453 so as to selectively couple either the 24-bit-wide 
output 451o of the A-CLUT 451 or the 24-bit-wide output 
452o of the B-CLUT 452 to a 24-bit wide A-input of a 45 
bypass multiplexer 454. A24-bil wide B-input of the bypass 
multiplexer 454 receives the output of CLUT-bypass unit 
448. A CLUT-bypass control signal 454c is applied to the 
control terminal of the bypass multiplexer 454 for selecting 
either the output of previous/current selecting multiplexer so 

453 or the output of CLUT-bypass unit 448 as the output of 
the bypass multiplexer 454. Multiplexer control signal 454c 
is user-programmable (by path-control data downloaded 
during the horizontal blanking interval) for selecting either 
the CLUT outputs (431o and 452o) or the output of the 55 
CLUT-bypass imit 448 as the output of bypass multiplexer 

454 on a line-by-line basis. 

The AI-lo-DO signal propagation delay of CLUT units 
451 and 452 is approximately 4 ticks of the video reference 
clock signal CV25M (24.5454 MHz). The CLUT-bypass 60 
unit 448 has a similar delay incorporated into it so that the 
same delay timing occurs regardless of whether signals 
flowing from the output 441o of capture-reordering multi- 
plexer 441 by way of CLUT 451/452 or bypass unit 448 are 
used. (A bebw described combination of units 457 and 458 65 
is provided with a similar 4-tick delay to match the signal 
propagation delay of CLUT units 451 and 452.) 



,772 Bl 

22 

The output of bypass multiplexer 454 couples to a 24-bit- 
wide destackcr input bus 4SSi Signals on the destacker- 
input bus 455i change in synchronism with the video refer- 
ence clock signal CV25M (24.5454 MHz). The sequence of 
time-multq>lexed 24-bit-wide signals on bus 455i is repre- 
sented in FIG. 4B as an over-time stack of datawords labeled 
03,1,2 next to line 4SSL This sequence will be explained in 
more detail later, in conjunction with FIG. 5. Note for now, 
however, that the sequence of signals is also labelled P/C/ 
P/C/. . . to represent a preferred sequence of data altemat- 
ingly belonging to a previous and current row of the low- 
resolution source image 125 (see FIG. 1). 

A 24-bit dcstacker 455 is provided for converting the 
format of signals output by bypass multiplexer 454 (or 
alternatively signals output by slipstream multiplexer 443) 
from an over-time serial format to a pipelined time-parallel 
format. This will also be explained in more detail when FIG. 
5 is discussed. 

Dcstacker 455 produces four destackcd signals, LPxO, 
LPxl, LPx2, LPx3, in parallel pipelined fashion, where each 
signal is 24-bits-wide. Destacked signals, LPxO, LPxl, 
LPx2, LPx3, arc then supplied to interpolator 459 for 
interpolation. A preferred embodiment of interpolator 459 
will be explained in more detail later, in conjunction with 
later described FIGS. 6A-6D, 7 and 8. For now, it is 
suflBcient to note that the interpolator 459 produces an 
interpolated output signal 460 (RGB-OUI) in accordance 
with the values of destacked signals, LPxO, LPxl, LPx2, 
LPx3, and in accordance with four subposition signals SPO, 
SPl, SP2, SP3, supplied to it from a 2-bit destacker 456 by 
way of a choice-making unit 457 and a choice-capturing 
multiplexer unit 458. Interpolator unit 459 should be viewed 
as being capable of combining its received destacked 
signals, LPxO, LPxl, LPx2, and LPx3, in accordance with 
any one of a plurality of predefined interpolation algorithms. 
The applied subposition signals, SPO, SPl, SP2, and SP3, 
select one of those predefined interpolation algorithms as the 
algorithm that is to be followed by interpolator unit 459. 

The 2-bit destacker 456 operates in similar fashion as 
does the 24-bit destacker 455. It (the 2-bit destacker 456) 
converts serially-arranged subposition data delivered to it 
over a 2-bit-wide destacker-input bus 45 6i from the 
SP-reordering multiplexer 442 into a set of four time- 
parallel subposition signals, SPO, SPl, SP2, SP3 (each 
2-bits-wide). 

These four signals (SP0-SP4) then pass into choice- 
making unit 457. Choice-making unit 457 generates four 
choice signals CO, CI, C2, and C3. An HION«0 signal may 
be applied to choice-making unit 457 so that the latter makes 
modified choices (MO, Ml, M2, and M3) whose end result 
is to create an appearance that horizontal interpolation has 
been turned off. A VION=0 signal may be further applied to 
choice-making \mii 457 so that the latter makes modified 
choices whose end result is to create an appearance that 
vertical interpolation has been turned off. Either one or both 
of HION and VION can be set to logic one or logic zero. 

Choice-capturing multiplexer unit 458 captures the choice 
signals CO, CI, C2, C3, (or modified choice signals MO, Ml, 
M2, and M3) generated by choice-making xmit 457. TWo of 
the four choice signals (C0-C3) are selected by the choice- 
capturing multiplexer unit 458, delayed to compensate for 
the delay of the 24-bit path (the path between multiplexer 
output 441o and the 24-bit dcstadcer input 455i), and then 
forwarded in a first clock cycle to the interpolator 459 as 
delayed/multiplexed signals, MxO and Mxl (each of which 
is 2-bits wide). The two non-selected ones of choice signals, 
CO, CI, C2, C3, are pipelined in the choice-capturing 
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multiplexer unit 458 and forwarded to the interpolator 459 
as dclayed/mult^lcxed signals, MxO and Mxl, in the next 
clock cycle. In FIG. 4C, the timing of the delayed/ 
multiplexed signals, MxO and Mxl, over repeated first and 
second cycles, is represented by strobe signals, 2PL1 and 5 
2PL2. 

Hie combined signal propagation delay of choice -making 
unit 457 and choice-capturing multiplexer unit 458 is set to 
4-ticks of the video reference clock signal CV25M (245454 
MHz) to match the signal propagation delay of GLUT units lo 
451 and 452 (or OLUT-bypass unit 448) so that delayed/ 
multiplexed signals, MxO and Mxl, arrive at interpolator 
459 in synchronism with corresponding signals LPxO-LPx3. 

Interpolator 459 generates a 24-bit-wide interpolated out- 
put signal 460 by adding the s\3m of two, nonexhaustively 15 
chosen LPx*s to the sum of two nonexhaustively, further 
chosen LPx's, thereby creating a sum of four, nonexhaus- 
tively chosen LPx's. The sum of the four nonexhaustively 
chosen LPx's is then divided by four (wire-shifted right by 
two bits) so that the generated output signal 460 represents 20 
the average value of the four LPx values. 

Interpolated output signal 460 passes through a 24-to-12 
bit mtiltiplexer 465 \\^ere it is converted from a 24-bit-wide 
per two-cycles format to two a format of two 12-bit-wide 
signals altemated over the two cycles. TTie 12-bit-wide 25 
signal 469 output by the 24-to-12 bit multiplexer 465 is 
shown in FIG. 4C as an ADOXXr signal. This AD OUT signal 
is transmitted out of the CLIO chip 430 at the video rate of 
24.5454 MHz and thereafter it is displayed on a high- 
resolution monitor (e.g., a color CRT or color LCD panel, 30 
not shown). 

The end result of the above-described arrangement of 
plural memory banks 420L, 420R (FIG. 4A), S-bus 423, 
capture registers 432-439 (FIG. 4B), reordering- 
multiplexers 441-442, previous/current selecting multi- 35 
plexer 453, bypass multiplexer 454, destackers 455, 456, 
and 24-to-12 bit multiplexer 465, is that signals are repeat- 
edly converted between parallel and serial formats as they 
flow downstream through a pipelined architecture. The 
parallel-to-serial-to-paraliel conversions help to reduce the 40 
die-fiize and pin count of the CLIO chip 430 and help to take 
full advantage of the Umited throughput bandwidth available 
on the S-bus 423. Note for example, that only 12 output pins 
are used for outputling the 12-bil-wide ADOUT output 
signal 469 firom the CLIO chip 430. The output of capture- 45 
reordering multiplexer 441 is only 15-bits-wide rather than 
30-bits-wide because of the use of demtiltiplexer 445. When 
the A-CLUT 451 and B-CLUT 452 are implemented as 
software-defined portions of the above-mentioned SRAM 
with 7-bit-wide AI ports, previous/current selecting multi- 50 
plexer 453 merges into the CLUT address-processing cir- 
cuitry and DO busses 451o and 452o are implemented 
within the CLIO chip 430 as one 24-bit-wide bus, thereby 
consuming less space within the CLIO chip 430. 

As already mentioned, the 24-bit destacker 455 demulti- 55 
plexes the signals of destadcer-input bus 455i in groups of 
four to produce a time parallel set of four pixel color/shade/ 
illumination value defining signals, LPxO, LPxl, LPx2, and 
LPx3, each being 24-bits-wide. These signals correspond to 
the four source pixels of FIG. 2, but not necessarily in the 60 
same numerical order. 

Referring to FIG. 4D, the structure and operation of one 
embodiment 1431 of the S-bus control circuit 431 is now 
detailed. Signals referred to here sometimes have a back- 
slash sufBx "V or a capital "B" suffix or the suffix "-bar". 65 
These notations all mean the same thing, that the signal is in 
negative logic format. Thus the signal labeled "CAPCLK- 
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ENB" in FIG. 40 is the same as the signal labeled "CAP- 
CLKEN\" in FIG. 4C. 

AND gate 1402 of FIG. 4D supplies the logic AND of 
inverted left and right serial clock signals, LSC\ and RSC\ 
to the D input of flipflop 1403. FUpflop 1403 is clocked by 
the video reference clock signal CV25M. FUpflops 1404 and 
1405 are similarly clocked by CV25M and they respectively 
produce delayed versions, RSCAP and LSCAP, of serial 
clock signals, RSCV and LSa. The Q-bar output (QN) of 
flipflop 1403 passes through inverter 1406 to produce 
capture-enabling signal CAPCLKENB, 

OR gate 1410 applies the logic OR of signals LSCAP and 
CAPCLKENB to the inhibit (INH) terminal of 16-bit wide 
HV-CAP register 1433 for capturing RGB data and SP data 
into that register 1433 from the upper portion (bits 31:16) of 
the S-bus 423. HV-CAP register 1433 is clocked by the 
CV25M video reference clock. 

OR gate 1412 supplies the logic OR of signals RSCAP 
and CAPCLKENB to the INR terminal of 16-bit wide 
LV-CAP register 1432. LV-CAP register 1432 captures RGB 
and SP data off the lower portion (bits 15:0) of S-bus 423. 
Like register 1433, the LV-CAP register 1432 is clocked by 
the CV25M signal. 

HS-CAPl register 1437 and LS-CAPl register 1436 are 
each clocked by an inverted version of the video reference 
clock signal CV25M. OR gate 1414 applies a signal CAPL, 
which is the logic or of RSCAP and CAPCLKENB, to the 
INH terminal of register 1437. OR gate 1416 supphes a 
signal CAPR which is the logic or of signals LSCAP and 
CAPCLKENB to the INH terminal of register LS-CAPl 
1436. The 16-bit wide input of HS-CAPl register 1437 
connects to the upper portion of S-bus 423. The 16-bit wide 
input of LS-CAPl register 1436 connects to the lower 
portion of S-bus 423. 

The 16-bit wide output of register 1437 is referenced as 
LDArA(15:0). The 16-bit wide output of register 1436 is 
referenced as RDATA(15:0). 

Register HS-CAP2 1438 has a 24-bit wide input which 
receives the LDATA(15:0) signal from register 1437 and 
additionally, bits 23 through 16 of S-bus 423. LS-CAP2 
register 1439 also has a 24-bit wide input which receives 
signal RDAIA(15:0) from register 1436 plus bits 7 through 
0 of S-bus 423. The 24-bil wide ou^uts of registers 1438 
and 1439 represent upper and lower captured portions of the 
sUpstream data. These signals are applied to opposed inputs 
of multiplexer 1443. The output of multiplexer 1443 
becomes the 24-bit wide slipstream output signal 443a 

The outputs of V-CAP registers 1432 and 1433 are apphed 
to opposed inputs of multiplexer 1441. The signal select 
terminal of multiplexer 1441 is driven by set/reset flipflop 
1440. A logic one ("1") on the Q-bar output of flipflop 1405 
sets flipflop 1440. A logic one ("1") on the Q-bar of flipflop 
1404 resets flipflop 1440. Flipflop 1440 is clocked by the 
CV25M video reference signal. The 16-bit wide output 
1441o of multiplexer 1441 represents the combination of 
buses 441o and 442o of FIG. 4B. 

Referring to FIG. 4E, a conceptual view of system 400 is 
shown. Data words from left memory bank 1420L and right 
memory bank 1420R are interleaved as shown and 
sequenced into pipelined system 1450. The data word which 
is apphed earliest in time represents the color/shading of a 
low-resolution pixel in the current low-resolution row (cLR) 
and current low resolution-column (cLC). The next data 
word represents low resolution pixel in the previous low 
resolution row (pLR) and the current low resolution column 
(cLC). The third apphed data word represents a low reso- 
lution pixel in the current low resolution row (cLR) and 
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previous low resolution column (pLC). The fourth supplied 
data word represents the color/shading of a low resolution 
pixel in the previous low resolution row (pLR) and previous 
low resolution colximn (pLC). 

Fifteen-bit wide portions of these interleaved data words 
pass through CLUT unit 1451 where they are expanded into 
a corresponding interleaved stream of 24-bit wide data 
words (referred to as PEN signals). PEN destacker 1455 
outputs these data words in time parallel form as shown. The 
"p" represents previous in the destacked formation. The "c" 
represents current. "LR" represents a low resolution row. 
"LC represents a low resolution column. 

At the same time, corresponding 2-bit wide subposition 
data words move through delay matching unit 1458 and into 
SP destacker unit 1456 for destacking by the SP destacker 
unit 1456. The signal-propagation delay of delay matching 
unit 1458 is set substantially eqxial to the signal-propagation 
delay of (XUT unit 1451 so that corresponding supposition 
data and PEN data are applied in synchronism to interpolator 
unit 1459. 

Referring to FIG, 5, the structure and operation of 24-bit 
destacker unit 455 are now detailed. Ticks of the video 
reference clock (CV25M «24.5454 MHz) are divided into 
adjacent groups of four ticks each with an active-high 
REGCLKl pulse occupying the first tick in a group and 
active-high REGCLK2 pulse occupying the third tick of the 
group, as shown. 

Hie 24-bit-wide signals appearing on destacker-input bus 
455j are identified in order as SO, S3, SI, 82, SA and SB 
according to their time of appearance. So being the first in 
time. These signals pass through multiplexer 500 onto bus 
500o when slipstream mode is inactive. If slipstream mode 
is active, one or more of the corresponding slipstream 
signals, SSO, SS3, SSI, SS2, SSA and SSB, moving down- 
stream along slipstream input bus 443a 1 can be substituted, 
by appropriate actuation of multiplexer 500, for a corre- 
sponding one or more of signals SO, S3, SI, S2, SA and SB 
on bus 455i. 

Although there is only one, "current" line of slip stream 
data arriving from the slip stream source 424, stip stream, 
pixels are interpolated by pretending that a "previous" line 
exists and the pixels of the previous slipstream line are the 
same as those of the current slipstream line. Substitution of 
slipstream pixels in place of some of the VRAM produced 
pixels creates a picture-in-picture effect. Interpolation can be 
used to smooth the seam between a slipstream image region 
and an immediately adjacent VRAM image region. Note that 
the VRAM data originates in a 15 bits per pixel RGB format, 
the slipstream data originates in a 24 bits per pixel RGB 
format, and yet the two can be merged into a single image. 

Destacker unit 455 includes five 24-bit-wide latches 
respectively labeled as 501, 502, 511, 512 and 522. The 
REGCLKl pulse signal is applied to the latch-enable (E) 
terminal of latch 501. The REGCLK2 puJse signal is applied 
to the latch-enable (E) terminals of the remaining latches, 
502, 511, 512 and 522. Destacker-input bus 500 connects to 
the inputs of latches 501 and 502. The output of latch 511 
defines signal node LPxl (named after the signal generated 
there) and also connects by way of multiplexer 531 to the 
input of latch 512. (If slipstream mode is active, one or more 
of delayed slipstream signals, SSO', SS3', SSI', SS2*, SSA' 
and SSB*, moving downstream abng slipstream input bus 
443o.2 can be substituted, by appropriate actuation of mul- 
tiplexer 531, for a corresponding one or more of the normal 
video ("V") signals passing from latch 511 to latch 512.) The 
output of latch 512 defines signal node LPxO. The output of 
latch 502 defines signal node LPx2 and also connects by way 
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of multiplexer 532 to the input of latch 522. (If slipstream 
mode is active, one or more of delayed slipstream signals, 
SSO*, SS3*, SSI', SS2', SSA' and SSB', moving downstream 
along slipstream input bus 443o.2 can be substituted, by 

5 appropriate actuation of multiplexer 532, for a correspond- 
ing one or more of the normal video ("V*) signals passing 
fi-om latch 502 to latch 522.) The output of latdi 522 defines 
signal node LPx3. 
At the timepoint denoted as "TIME P' (first REGCLKl 

10 puJse), signal SO loads into latch 501. At timepoint Q (first 
REGCLK2 pulse), signal SO loads into latch 511 while 
signal S3 loads into latch 502. At timepoint R (second 
REGCLKl pulse), signal SI loads into latch 501. At time- 
point S (second REGCLK2 pulse), signal SI loads into latch 

15 511 while signal S2 loads into latch 502. At the same time, 
signal SO loads into latch 512 and signal S3 loads into latch 
522. The signals present at respective nodes LPxl, LPxO, 
LPx2 and LPx3 are therefore time-delayed, parallel-wise 
presented replicas of SI, SO, S2 and S3. 

^ At a following timepoint P ("Next P''), the signals present 
at respective nodes LPxl, LPxO, LPx2 and LPx3 are still SI, 
SO, S2 and S3. At a following timepoint Q ("Next Q") , 
however, the signals present at respective nodes LPxl, 
LPxO, LPx2 and LPx3 are replicas of SA, SI, SB and S2, 

^ where SI and S2 represent pixel values of a previous column 
in the low-resolution image matrix and SAand SB represent 
pixel values of a current column in the low-resolution image 
matrix (see FIGS. 1 and 2). 

^ Note that in the transition between timepoints R and S, 
input signals SO and S3 shift over from nodes LPxl and 
LPx2 to nodes LPxO and LPx3. Input signals SI and S2 
appear for the first time on nodes LPxO and LPx3. In the 
transition between timepoints "Next P' and "Next Q", 
signals SO and S3 shift out and disappear while signals SI 
and S2 shift over, in pipeline fashion, from nodes LPxl and 
LPx2 to nodes LPxO and LPx3. Signals SA and SB appear 
for the first time on nodes LPxO and LPx3. The process 
repeats for data subscquentiy delivered over the destacker- 
input bus 455/. 

40 

The 2-bit destadcer 456 (FIG. 4B) operates in the same 
way except it consists of 2-bit-wide latches rather than 
24-bit-wide latches and it does not process sUpstream data. 
Hie earlier mentioned choice-making and forward/ 

45 backward mapping occur within choice-making tmit 457 
(FIG. 4B). FIG. 6A shows one such process in more detail. 
The destacked subposition signals, SPO, SPl, SP2, SP3, are 
delivered in parallel to a forward-mapping unit (FMU) 610 
together with target configuration signals X and Y. (X is the 

50 same as Field odd/even indicating signal FO.) 

T^et configuration signal Y is generated by Y-generating 
circuit 600. Video clock signal CV25M (24.5454 MHz) 
drives the clock inputs of D-type flip flops 601 and 602. A 
READENB signal resets flip flop 601 at the end of each 

55 horizontal blanking interval. FUp flop 601 has its Q\ (read 
this as Q-bar or Q-not) output coupled to its D input so that 
it toggles its state each time it is enabled by the CAPCLK- 
ENB signal (developed in FIG. 4D as the delayed logical 
AND of LSC\ and RSQ (In FIG, 6A, SPN is the negative 

60 sampling node of flip flop 601.) Flip flop 602 provides a one 
tick delay and forwards both the noninverted (Q) and 
inverted (Q^ versions of the toggling signal to multiplexer 
603. Depending on the state of the Field odd/even indicating 
signal FO applied to the selector input of multiplexer 603, its 

65 output, Y, starts off high or low at the start of each horizontal 
display line and toggles thereafter in synchronism with the 
video clock signal CV25M (24.5454 MHz). 
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Forward-mapping unit (FMU) 610 converts the four 
destacked subposition signals, SPO, SPl, SP2, SP3, into 

universal subposition si^^^^^ iFTAROETCOis onleftand moN^: 

with earher-descnbed FIG. 3F. Internally, FMU 610 com- suBsnnrrE choice o-o for each original choice 

prises four combinatorial logic circuits each providing the ^ c-i; 

function of forward-mapping table unit 310. suBsmuTE choice c-3 for each original choice 

C"2; 

Universal choice making unit (CMU) 620 converts the endif. 

four universal subposition signals AO, Al, A2, A3, into four target is on right and hion-o: 

miiversal choice signals, BO, Bl. B2, B3, in accordance with suSJJl tl Sr ^ch ^ 

earlier-described FIG. 3F. Internally, CMU 620 comprises a bndif. 

plurality of combinatorial logic circuits which provide the — — 

™J?>?,^L*'*'^°'^ code-conversioD TABLE 1 in the ilhtstrated example of FIG. 6B.1, subposition points 

(riTCONPDS). SPO-^3 are positioned such that SPl is placed very close to 

Backward-mapping unit (BMU) 630 converts the four 15 the target (T) while SPO, SP3 and SP2 arc positioned as far 

universal choice signals, BO, Bl, B2, B3, into target- away as possible from the target position (T). The normal 

configuration specific choice signals CO, CI, C2, C3, in interpolation algorithm (wherein HION and VION are both 

accordance with earlier-described FIG. 3F. Internally, BMU ^et to a logic tnie or "1") wiU therefore choose the color/ 

630 comprises four combinatorial logic circuits each pro- f'?^^"^^ f^J"^ ^^^i "^^^^ P^°^^ly 

•J- n cc J • * i_i * 't'lft 5n three or four of its four choices for averagmg equation Eq. 

viQing me nincuon or rorwara-mappmg laoie umi «u. 2. However, because HION is reset to logic false ("0") and 

Choice signals CO, CI, C2, and C3 pass on to correspond- the target (T) is on the left side, choice-revising units 
ing ones of choice-revising units, 640, 641, 642, and 643. 640-643 will replace each choice of LPxl with a substitute 
The choice-revising units 640 through 643 convert choice choice of LPxO, If LPx2 is selected as one of the C0-C3 
signals CO, CI, C2, and C3 to respective, modified choice- 25 choices, that selection will be replaced by a choice of LPx3. 
signals MO, Ml, M2, and M3 in accordance with a Thus, all the revised choices, M0-M3 will focus on the left 
horizontal-interpolation activating signal, HION, and a (L) half of window 248 rather than on the ri^^ 
vertical-interpolation activating signal, VION, supplied to ^ 'ri'y/^^'f f "^^^"t 
units 640-643. Modified signals MO, Ml, M2, and M3 are ^^^'^ical mterpolaUon is turned off (VION=0) but horizontal 
the same as original choice signals CO, CI, C2, and C3 in the 30 interpolation ts left on (fflONol). In this case, choice- 
case where both the horizontal and vertical interpolation ^^^^ ™^ ^^^^ P^^^"^ following algorithm: 
activating signals are active (HIONol and VIONal). 

On the other hand, when one or both of the horizontal and 

vertical interpolation activating signals is inactive (HION°0 IF TARGET ON TO P AND viON-0: 

OR VION-0), choice-revising units 640-643 convert choice 35 subottute c=o for each c-3; 

signals CO, CI, C2, and C3 to respective, modified signals endie ^^'^^ 

MO, Ml. M2, and M3 so as to give the impression that the if target on BcyriDM and vion-O: 

respective horizontal or vertical interpolation operation has suBSTmJTE c-3 for each c-0; 

been turned off, suBSTTTurE 0-2 for each c-i; 

„ , , o . r . . . . endif. 

The code-conversion processes of each of choice-revising ^ 

units 640-643 is the same and is given by the below 

code-conversion TABLE 2 (HVON.FDS). Table input terms With the above algorithm, all of revised choices Ma-M3 

Cxi and CxO represent respective more and less-significant will focus on the low resolution row (LR) in which the target 

bits of a corresponding one, Cx, of 2-bit wide signals pixel resides. This will give the appearance that vertical 

C0-C3. Table output terms Mzl and MzO represent respec- 45 interpolation has been turned off. 

tive more and less-significant bits of a corresponding one. If horizontal-interpolation and verlical- 

Mz, of 2-bit wide signals M0-M3. interpolation activating signals are switched to FALSE 

nOS. 6B.I and 6B.2 are provided to explain the opera- ("^^^l:^' Y^^^^^ algoriUims of both FIG. 6B 1 

tions of units 640-643 by way of example. performed one after the aext^THe result 

, . . , 1 . 1 . 50 of executing both algorithms is that the same choice value 

FIG. 6B.1 shows the MndiUon where horizoiital mtetpo- ^ ^ ^^^^ interpolator 459, where the 

laUonisturQedoff(HION.=0)butverUcalmterpo^^^^ ^^^^ ^^^^ ^ color/shading code of the low 

on (VIONol). The high-resoluUon ta^et pixel (T) is shown resolution pixel under which the target high resolution pixel 

ocatcd withm interpolation window 248 m quadrant QC of ^ ^^^^^ iUustrated example of HGS. 6B.1 and 

low-resolution pixel LPxO. gg^^ ^^^^^^ ^ ^^^^^ LPxO, and as a consequence, 

Interpolation window 248 is divided into left and right when HION=0 and VION-O, the four revised choices, 

halves (L and R). Because the target high resolution target M0-M3 will all point to LPxO. 

pixel (1) is located in the left half of window 248, and The approach taken in FIGS. 6A, 6B.1 and 6B.2 is simple 

horizontal interpolation is turned off (HION«0), it is desir- and effective. However, it suffers from a slight drawback, 

able to pretend that the right haff of window 248 does not ^ Looking momentarily back to FIG. 6B.1, note that subpo- 

exist. sition point SPl contributes most heavily to the choice - 

One way of doing so is to replace any choices of color/ making process of units 610-630 because SPl is positioned 

shading codes of LPx's in the right half of interpolation closest to the target point (1^. Ideally, if horizontal interpo- 

window 248 with corresponding choices in the left half of lation is supposed to be turned off, subposition point SPl 

window 248. Choice-revising units 640—643 perform 65 should not in any way bias the choices made by units 

according to the following algorithm for the case where 610-630. But in the post-choice revising scheme of FIG. 6 A, 

horizontal interpolation is to be tumed off: it does. 
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Referring to FIGS. 6C, 6D.1, and 6D^, a second 
approach in aocoidancc with the invention modifies the 
subposition values (SP0-SP3) before they are applied to 
choice-making units 610-630. This pre-choice modifying 
scheme reduces the problem of bias from supposedly not- 5 
present subposition signals. 

In the example illustrated within FIG. 6D.1 note that 
original subposition point SPl is shifted to a new, modified 
subposition point, MSPl, thereby moving further away firom 
the target position (1). Original subposition SP2 is shifted to 
new, modified subposition MSP2 to again increase its dis- 
tance away from the target position At the same time, 
original subposition point SPO is shifted right to create the 
new, modified subposition point MSPO which is closer to 
target position T. Similarly, SP3 is shifted rigjit to new 
position MSP3 which is closer to target position T. 

The algorithm performed in FIG. 6D.1 is described as 
follows. If horizontal interpolation is turned off (HION=0) 
but vertical interpolation is left on (VIONal), the interpo- 
lation window 248 is divided into left and right halves. The 
half in which the target high-resolution pixel (T) resides is ^ 
defined as "interesting". The half in which die target pixel 
(T) does not reside is deemed to be "uninteresting". Hie 
original subposition points SP0-SP3 and the new, modified 
subposition points MSP0-MSP3 are respectively defined by 
their (SPv> SPj^) coordinates. Then the following algorithm ^ 
is performed: 



15 



30 



[F VtON-l AND fflON-0: 

FIRSrr SET THE (SPv, SPh) COORDINAreS OF ALL 
MSP's EQUAL TO THAT OF ALL SP's; 
SET THE SPh COORDINArE OF EVERY MSP EQUAL TO 
THE SP„ COORDINAIE OF THE TARGET POSmON; 
SET THE SPv COORDtNATE OF EACH MSP IN THE 
UNINTERESTING HALF TO BE OFPOSfTB OF THE SPv 35 
COORDINATE OF THE TARGET FOSETTON; 
ENDIF. 



Another way to look at the same algorithm is to view the 
column in which the target resides as a "KEEP" column and 40 
to view the non mirror one of the columns in which the 
uninteresting half of window 248 as also being a "KEEP" 
column. The remaining two columns arc deemed as "COL- 
LAPSE" columns. Subposition points that arc originally in 
the COLLAPSE columns are moved to the KEEP columns. 45 

FIG. 6D.2 shows the counterpart algorithm for the case 
where vertical interpolation is turned off but horizontal 
interpolation in left on. The top or bottom half of window 
248 in which the target resides is defined as "interesting". 
The half in which the target does not reside is deemed as 50 
"uninteresting". The subposition-modifying algorithm is 
then defined as follows: 



55 



IFVlON-OANDHION-l: 

IF NOT YET DONE, FIRST SET THE (SPv, SPh) 
COORDINATES OF ALL MSP's EQUAL TO THAT OF THE 
CORRESPONDING SP's; 

SET THE SPv COORDINATE OF EVERY MSP POINT EQUAL 
TO THE SPv COORDINATE OF THE TARGET, 
SET THE SPh COORDINATE OF MSP's IN THE 
UNINTEREOTNG HALF TO BE OPPOSrTE THAT OF THE 
SP„ COORDINATE OF IHE TARGET, 
ENDIF. 



FIG. 6C shows the circmt for performing the above 65 
functions. Note that subposition-modifying units 1640-1643 
are now placed ahead of choice-making units 610-630. A 



different code-conversion table is used to define each of 
subposition-modifying units 1640-1643. The below code- 
conversion tables 3.0 through 3,3 respectively define the 
input and output bits of respective modifying units 1640 
through 1643. Input parameter SPxl represents the more 
significant bit and input parameter SPxO represents the less 
significant bit of a respective aibposition signal SPx selected 
fi-om a respective one of SP0-SP3. Similarly, output param- 
eters MSPxl and MSPxO represent respective more and less 
significant portions of each output signal MSPx selected 
firom the set MSP0-MSP3. 

The respective outputs of units 640-^43 in FIG. 6A are 
referenced respectively as M0-M3. The outputs of unit 630 
in FIG. 6C is similarly referenced as M0-M3*. 

Referring to FIG. 7, the modified choices M0-M3 (or 
M0'-M3* if the embodiment of FIG. 6C is used) are next 
applied to the illustrated MUXCAPunit 458. Eight-bit wide 
register 705 captures the modified choice signals M0-M3. A 
CAPEND7B signal connects to the inhibit (INH) terminal of 
register 705 to define the choice capture time. The 
CAPEND7B signal represents the capture enable signal 
CAPCLKEN (see RG. 4C) where the delay is seven ticks of 
the CV25M video reference clock. Register 701 develops 
the CAPEND7B signal from a supplied CAPEND6B signal. 
Register 702 develops a further delayed signal CAPEND8B 
from the CAPEND7B signal. 

The 8-bit wide output of register 705 is subdivided into 
one-tick delayed signals MO". Ml", M2", and M3". These 
delayed signals correspond to the modified choice signals 
M0-M3 (or M0'-M3') applied to the input side of register 
705. Delayed signals MO" and M2" are delivered to opposed 
inputs of multiplexer 706. Delayed signals Ml" and M3" are 
delivered to opposed inputs of multiplexer 707. The select 
terminals of multiplexers 706 and 707 are both driven by the 
CAPEND8B signal 

During a first phase of the CAPEND8B signal, multiplex- 
ers 706 and 707 deliver respective signals MO" and Ml" to 
the 4-bit wide input of register 708. During a second phase 
of the CAPEND8B signal, multiplexers 706 and 707 dehver 
respective signals M2" and M3" to the 4-bit wide input of 
register 708. Register 708 is clocked by the video reference 
clock signal CV25M, as are registers 701, 702 and 705. The 
4-bit wide output of register 708 couples to the input of 4-bit 
wide register 709. Register 709 is also clocked by the 
CV25M signal. The output of register 709 defines a first 
multiplexed, modified choice signal MxO (2 bits wide) and 
a second multiplexed, modified choice signal Mxl (2 bits 
wide). 

The delay from the input of choice making unit 457 (FIG. 
4B) to the output of register 705 is approximately two licks 
of the video reference clock CV25M. The delay from the 
output of register 705 to the output of register 709 is two 
more ticks of the video reference clock CV25M. Accord- 
ingly the total delay of choice making unit 457 and MUX- 
CAP unit 458 is four ticks of the video reference clodc 
CV25M. This matches the four-tick signal-propagation 
delay time of the GLUT units 451 and 452 (FIG. 4B). 

FIG. 8 shows the internal structure of interpolator 459. 
Interpolation 459 is divided into respective R, G and B units, 
800R, 800G and 800B (e.g., red, green, blue color handhng 
units). Only unit 800R is shown in detail. Units 800G and 
800B are xmderstood to have internal similar structures. 

Unit 800R receives the 8-bit wide "R" components of 
each of the 24-bit wide, destacked signals, LPxO, LPxl, 
LPx2, LPx3, and produces a corresponding 8-bit wide 
ROUT signaL Unit 800G receives the 8-bit wide "IG" 
components of each of the 24-bit wide, destacked signals. 
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LPxO, LPxl, LPx2, LPx3, and produces a corresponding ones of destacked R signals, LPxO, LPxl, LPx2, LPx3, 

8-bit wide GOUT signal. Unit 800G receives the 8-bit wide divided by fotir. In one embodiment, because the lower two 

"G" components of each of the 24-bit wide, destacked bits are thrown away by unit 735, those portions of preced- 

signals, LPxO, LPxl, LPx2, LPx3, and produces a corre- ing unit 730 which ou^ut these two bits are eUminated to 

sponding 8-bit wide GOUT signal. Unit 800B receives the 5 save circuit space. 

S-bit wide «B» components of each of the 24.bit wide, . Result signd 736 is synchronized to the video clodc 

destacked signals, LPxO, LPxl, LPx2, LPx3, and produces signal CV25M by storing it m register 737. The si^^ 

a corresponding 84>it wide BOUT signal. Output signals synchroiuzing register 737 represents bits 5:0 of the 

T} Hlkr^ ^^"^'^"^ " ' 10 retrt:rmt^^^ 

output signal RGBOUT ^ , ^aar, ^ • the sum of four chosen ones of destacked R portions of 

Referrmg to the detailed schematic of unit 800R dunng ^^^^^ lPxO, LPxl, LPx2, LPx3, divided by four. Result 
each Uck of the video reference dock signal CV25M, ^^^^ j^^^ synchronized to the video clodc signal 
muhiplexer 710 picks one of the R values of destacked CV25M by storing it in register 747. The combined outputs 
signals, LPxO, LPxl, LPx2, LPx3, m accordance with the of registers 737 and 747 form the 8-bit wide ROUT signal. 
MxO choice signal supplied to a control terminal of multi- 15 produced RGBOUT signal of units 800R, 800G and 
plcxer 710. Multiplexer 710 supplies the picked LPx value gooB is ultimately transmitted out of the CUO chip 430 and 
to the A-input of first adding unit 712. During the same clock used to produce a corresponding light image on an appro- 
tick, multiplexer 711 picks one of the R values of destacked priate display means (e.g. a color CRT or color LCD), 
signals, LPxO, LPxl, LPx2, LPx3, in accordance with the When both of the HION and VION interpolation- 
Mxl choice signal suppUed to its select control terminal. 20 activating signals are switched to the true state, the machine- 
Multiplexer 711 supplies the picked LPx value to the internal 320-by-240 pixels low-resolution image (element 
B-input of first adding unit 712. 125 in FIG. 1) is transformed into a hght image (clement 165 

First adding unit 712 generates first-sum signal 714 in FIG. 1) that has an apparent high-resohition of 640-by- 

during each tick. This first-sum signal 714 represents the 480 pixels. When only the HION interpolation-activating 

sum of two nonexhaustively diosen ones of destacked R 25 signal is switched to the true state, the machine-internal 

signals, LPxO, LPxl, LPx2, LPx3. On alternating ticks 320-by-240 pixels low-resolution image (element 125 in 

(indicated by ACLKl and ACLK2), the first-sum signal 714 FIG. 1) is transformed into a light image (element 165 in 

is stored into a respective one or the other of registers 721 FIG. 1) that has an apparent high-resolution of 640-by-240 

and 722. After an initializing tick, registers 721 and 722 pixels. When only the VION interpolation-activating signal 

respectively store, in pipelined fashion, the sums of a first 30 is switched to the true state, the machine-internal 320-by- 

chosen pair (current pair) and a second chosen pair of values 240 pixels low-resolution image (element 125 in FIG. 1) is 

(previous pair) selected from the set of destacked R signals, transformed into a light image (element 165 in FIG. 1) that 

LPxO, LPxl, LPx2, LPx3. Carry-out signals (addition has an apparent high-resolution of 320-by-480 pixels. And 

overflows) 715 produced by each pipefined addition step of when both HION and VION are switched to false, the 

adder 712 are simultaneously stored on alternating ticks in 35 machine-internal 320-by-240 pixels low-resolution image 

one or the other of registers 723 and 724. Signals designated (element 125 in FIG. 1) is transformed into a light image 

as "current" become "previous" data in the next successive (element 165 in FIG. 1) that has a same apparent resolution 

tick. Computation therefore proceeds through the circuit in of 320-by-240 pixels. Accordingly, the invention provides 

pipeline fashion. for a number of different transformations firom stored data 

Second adding unit 730 generates a second-sum signal 40 (125) to physical light image (165), 

734 during each tick. This second-sum signal 734 represents The transformation process need not be viewed as merely 

the sum of the four destacked R signals, LPxO, LPxl, LPx2, an interpolation process. The user-supplied subposition sig- 

LPx3 chosen by modified choice signals M0-M3. nals (SP0-SP3) can be seen as means for changing the colors 

A carry-out signal (addition overflow) 738 produced by of produced pixels. The user-supplied interpolation activat- 

adder 730 is supplied to a C input of a carries-addmg unit 45 ing signals (HION, VION) can be seen as means for chang- 

740 by way of inverter 739. Carries-adding xmit 740 is ing the apparent fuzziness or sharpness of the produced light 

two-bit plus carry adder with an inverted, 2-bit wide output, image. When subpositions are appropriately concentrated or 

740oB. Inverted versions of the carry-out signals previously scattered at the boimdary of two differently colored objects 

generated by adder 712 in successive ticks and stored in within a display image, the appearance of the boundary can 

registers 723 and 724 are applied to A and B inputs of 50 be highlighted by increasing or decreasing color intensity in 

carries-adding xinit 740. It turns out that the process of the region of the boimdary to create perception of a sharp 

inverting three 1-bit values, adding them, and inverting the edge. Conversely, the boundary can be blurred by smoothing 

2-bit result is logically equivalent to a noninverted addition the transition of colors and/or intensity as one moves from 

of the three values. Circuit size is minimized and use of two one image object to the next to thereby create a perception 

additional inverters is saved in the circuitry of FIG. 8 by 55 of a soft or rounded edge. Also, an appearance of different 

using the aheady inverted outputs (QN) of registers 723, 724 surface textures can be created by patterning subposition bits 

and an already available inverted output 740oB within the differently in areas that are to appear as different surfaces. 

2-bit plus carry adder 740. The 2-bit wide ou^)Ut 740oB of Moreover, anti-aliasing effects can be created to remove the 

unit 740 represents the sum of the three carry bits generated jagged edges appearance of angled lines by appropriate 

respectively by a first tick addition in adder 712, a second so manipulation scattering of subposition values within a dis- 

tick addition in adder 712, and the subsequent addition in play image. The various effects are developed empirically by 

adder unit 730. trying different distribution patterns of subposition values 

The second-sum signal 734 passes through a divide-by- and observing the resultant effect on a CRT or other display 

four unit 735 where it is shifted right by two bit positions means (e.g., LCD). 

(e.g.,ahard-wiredshiftrightof two). The result signal 736 65 CODE CONVERSION TABLES 

output by divide-by-four unit 735 then represents the less- The below code conversion Tables 1, 2, 3.0-3.3 each have 

significant 6 bits (ROUT bits 5:0) of the sum of four chosen the same format. Input data bits are presented in a left-hand 
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column in the same left to right order as recited next to the 
introduction "INPUTS: The corresponding ouiguX data 
bits are indicated on the same line in a right-hand colimin in 
the same left to right order as recited next to the introduction 
"OUTPITTS: . . . For purposes of speed and circuit 
compactness, the code-conversion functions are preferably 
implemented in the form of combinatorial logic circuitry 
which is designed using coDventional Kamough-mapping 
techniques or the like. Each input/output "1" represents a 
logic true electrical or other signal, each input/output "0" 
represents a logic false electrical or other signal, each 
input/output "x" bit represents a logic don't-care electrical 
or other signal. The code-conversion functions can be alter- 
natively implemented in the form of a ROM (read only 
memory) circuit or a computer program or the like. 
(Copyright Notice: In so far that the subject matter of the 
code-conversion tables is coverable by copyrights, the copy- 
right owner reserves all such rights except those expressly 
waived above.) 

TABLE 1 

(TTPCON.FDS) 
OOPYRIOOT e 1992 The 3DO Company 
CONTENTS OF CHOICE MAKING UNIT 320 OR 620 OR 1620 



10 



15 



20 



25 



CKTNAME: ITPCON; 

TYPE: COMB; 

INPUTS: AOl, AGO, All, AlO, A21, A20, A31, A30; 

OUTPUTS: BOl, BOO, Bll, BIO, B21, B20, B31, B30; 

^rr> 

00000000 01011010 

00000001 01101101 

00000010 01011010 

00000011 01011010 

00000100 01011001 

00000101 01011011 
00000110 01011001 
00000131 01011001 

00001000 01010101 

00001001 01011101 

00001010 01010101 

00001011 01010110 

00001100 01011001 

00001101 01011011 

00001110 01011001 

00001111 01010110 

00010000 01101001 

00010001 01101011 

00010010 01101001 

00010011 01101001 

00010100 01100011 

00010101 01101101 

00010110 01100011 

00010111 01011010 

ooonooo 01011000 

00011001 01100011 

00011010 01011000 

00011011 01011000 

00011100 01011000 

00011101 01100011 

00011110 01011000 

00011111 01011000 

00100000 01011010 

00100001 01101101 

00100010 01011010 

00100011 01011010 

00100100 01011001 

00100101 01011011 

00100110 01011001 

00100111 01011001 

00101000 01010101 

00101001 01011101 

00101010 01010101 

00101011 01010110 

00101100 01011001 

00101101 01011011 



35 



45 



50 
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T4BLE 1 -continued 



(TTPCON.FDS) 
COPYRIGHT e 1992 The 3DO Company 
CONTENTS OF CHOICE MAKING UNIT 320 OR 620 OR 1620 



65 



00101110 


01011001 


00101111 


01010110 


00110000 


01010101 


00110001 


01010101 


00110010 


01010101 


00110011 


01010101 


00110100 


01010101 


00110101 


01010101 


00110110 


01010101 


00110111 


01010101 


00111000 


01010101 


00111001 


01010101 


00111010 


01010101 


00111011 


01010101 


00111100 


01010101 


00111101 


01010101 


00111110 


01010101 


00111111 


01010101 


01000000 


01100001 


01000001 


01100011 


01000010 


01100001 


01000011 


01011010 


01000100 


01011000 


01000101 


01011000 


01000110 


01011000 


01000111 


01011000 


01001000 


01010001 


01001001 


01010011 


01001010 


01010001 


01001011 


01010001 


01001100 


01011000 


01001101 


01010011 


01001110 


01011000 


01001111 


01011000 


01010000 


01101000 


01010001 


01101000 


01010010 


01101000 


oloioon 


01101000 


01010101 


01100001 


01010101 


01100011 


01010110 


01100001 


01010111 


01100001 


01011000 


01100011 


01011001 


01001101 


01011010 


01100011 


01011011 


01011000 


01011100 


01100011 


01011101 


01100011 


01011110 


01100011 


01011111 


01100001 


01100000 


01100001 


01100001 


01100011 


01100010 


01100001 


01100011 


01011010 


01100100 


01011000 


01100101 


01011000 


01100110 


01011000 


01100111 


01011000 


01101000 


01010001 


01101001 


01010011 


01101010 


01010001 


01101011 


01010001 


01101100 


01011000 


01101101 


01010011 


01101110 


01011000 


01101111 


01011000 


01110000 


01010101 


01110001 


01010101 


01110010 


01010101 


01110011 


01010101 


01110100 


01010101 


01110101 


01010101 


01110110 


01010101 


01110111 


01010101 


01111000 


01010101 
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TABLE l-contioued 



(TTPCON.FDS) (nPCON.FDS) 
CX)PYRIGtrr e 1992 The 3DO Company COPYRIGHT © 1992 The 3DO Company 

CONTENTS OF CHOICE MAKING UNIT 320 OR 620 OR 1620 * CONTENTS OF CHOICE MAKING UNIT 320 OR 620 OR 1620 



01111001 


01010101 




11000100 


01011000 


01111010 


01010101 




11000101 


01011011 


01111011 


01010101 




11000110 


01011000 


01111100 


01010101 




11000111 


01011000 


01111101 


01010101 


10 


11001000 


01010001 


01111110 


01010101 




llOOlOOl 


01010011 


01111111 


01010101 




11001010 


01010001 


10000000 


01100001 




11001011 


01010110 


10000001 


01100011 




11001100 


01011000 


10000010 


01100001 




11001101 


01011101 


10000011 


01100001 


15 


11001110 


01011000 


10000100 


01100001 


11001111 


01011000 


10000201 


01100011 




11010000 


01101000 


10000110 


01100001 




11010001 


OllUlUll 


10000111 


01011000 




11010010 


01101000 


10001000 


01010000 




11010011 


01101000 


10001001 


01001101 


20 


11010100 


All AAAI 1 

UllOUull 


10001010 


01010000 


11010101 


A-l 1 AAA-I 1 

UllUUUll 


10001011 


01010000 




IIOIOIIU 


UllUUUll 


10001100 


01010000 




11010111 


A-l -1 AAAA-I 

UllUUUUl 


10001101 


01001101 




11011000 


01011000 


10001110 


01010000 




11011001 


A^ 1 AAA1 4 

OlluUull 


10001111 


01010000 


25 


11011010 


01011000 


10010000 


01100001 


11011011 


01011000 


10010001 


01100011 




11011100 


01011000 


10010010 


OllOOQOl 




11011101 


01100011 


looioon 


01101000 




11011110 


01011000 


10010100 


01100000 




11011111 


01011000 


10010101 


01100000 




11100000 


01011010 


10010110 


01100000 


30 


11100001 


01101101 


10010111 


01100000 




11100010 


01011010 


10011000 


01000001 




11100011 


OlOllOlU 


10011001 


01000011 




IIIOOIUO 


A1 A-t-l AAn 

01011 UuU 


10011010 


01000001 




I'll nrt-1 At 
lilUUlUl 


mni 1 ni 1 


10011011 


01000001 




iiinniin 


ninii nnn 


10011100 


01100000 


35 


iiinniii 

liiUUiil 


mnnnnn 

UIUllUUU 


10011101 


01000011 


mnifinn 


mm 0001 


10011110 


01100 000 




mninni 


01010011 


10011111 


UllUUUUU 




11101010 


01010001 




nii nnnfii 

UlIUUUUl 




11101011 


01010110 


minnnni 


niinnnii 




11101100 


01011 000 


lUiUUUiU 


minnnni 


40 


11101101 


01011101 


10100011 


01100001 


11101110 


ninii nnn 

UIUllUUU 


10100100 


01100001 




11101111 


01011000 


10100101 


01100011 




111 mnnn 


mninmi 

UIUIUIUI 


10100110 


01100001 




111 inrvii 


nininini 

UiUlUlUl 


10100111 


01011000 




11110010 


01010101 


inininnn 


01010000 


45 


11110011 


01010101 


10101001 


01001101 


IIIIUIUU 


mm mm 
UlUlUlUi 


10101010 


01010000 




iiiioiui 


UIUIUIUI 


10101011 


01010000 




11110110 


01010101 




01010000 




11110111 


01010101 


10101101 


01001101 




11111000 


01010101 


10101110 


OlOlOOOO 




11111001 


01010101 


10101111 


01010000 


50 


11111010 


01010101 


10110000 


01010101 




11111011 


01010101 


10110001 


01010101 




11111100 


01010101 


10110010 


01010101 




11111101 


01010101 


10110011 


01010101 




11111110 


01010101 


10110100 


01010101 




11111111 


01010101 


10110101 


01010101 


55 


<END> 


10110110 


01010101 






10110111 


01010101 








10111000 


01010101 








10111001 


01010101 








10111010 


01010101 
01010101 
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10111011 


60 






10111100 


01010101 




(HVON.FDS) 


10111101 


01010101 




CONTENTS OF EACH OF HA^ CONTROL UNITS 640-643 


10111110 


01010101 
01010101 




COPYRIGHT© 1992 The 3D0 Company 


10111111 








11000000 


01010101 




CKINAME; 


HVON; 


11000001 


01101101 




TYPE: 


COMB; 


11000010 


01011010 


65 


INPUTS: 


F0,Y,HION,VION,Cxl,Cx0; 


11000011 


01011010 




OUTPUTS: 


MZ1,MZ0; 
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TABLE 2-continued 



TABLE 3.0 



(HVON.FDS) 

CONTENTS OF EACH OF H/V CONTROL UNITS 640-643 
COPYRIGHT© 19921116 3D0 Company 



(HVOON.FCS) 
CONTENTS OF WV CONTROL UNIT 1640 
COFYRIOHF© 1992 The 3DO Company 



-<iTT> 

000000 
000001 
000010 
000011 
000100 
000101 
000110 
000111 
001000 
001001 
001010 
001011 
001100 
001101 
001110 
001111 
010000 
010001 
010010 
010011 
010100 
010101 
010110 
010111 
011000 
011001 
011010 
011011 
011100 
011101 
011110 
011111 
100000 
100001 
100010 
100011 
100100 
lOOlOl 
100110 
100111 
101000 
101001 
101010 
101011 
101100 
101101 
101110 
101111 
110000 
110001 
110010 
110011 
110100 
110101 
110110 
110111 
111000 
111001 
111010 
111011 
111100 

inioi 

111110 

111111 

<END> 



00 
00 
00 
00 
00 
00 

11 
11 

00 
01 
01 
00 
00 
01 
10 

11 

01 
01 
01 
01 
01 
01 
10 
10 
00 
01 
01 
00 
00 
01 
10 

11 

10 
10 
10 
10 
01 
01 
10 
10 

11 

10 
10 

11 

00 
01 
10 

11 
11 
11 
11 
11 

00 
00 

11 
11 
11 

10 
10 

11 

00 
01 
10 

11 



10 



15 



20 



25 



30 



35 



40 



45 



50 



55 



65 



CKTNAME: 
TYPE: 
INPUTS: 
OUTPUTS: 

<Tr> 

000000 
000001 
000010 
000011 
000100 
000101 
000110 

aooiii 

001000 
001001 
001010 
001011 
001100 
001101 
001110 
001111 
010000 
010001 
010010 
010011 
010100 
010101 
010110 
010111 
011000 
011001 
011010 
011011 
011100 
011101 
011110 
011111 
100000 
100001 
100010 
100011 
100100 
100101 
100110 
100111 
101000 
101001 
101010 
101011 
101100 
101101 
101110 
101111 
110000 
110001 
110010 
110011 
110100 
110101 
110110 
110111 
111000 
111001 
111010 
111011 
111100 
111101 
111110 

111111 

<END> 



HVOON; 
COMB; 

VION^ON^,Y^Pxl ,SPxO; 
MSPxl^SPxO; 

10 
10 
10 
10 

11 
11 
11 
11 

00 
00 
00 
00 
01 
01 
01 
01 

11 

10 
10 

11 
11 

10 
10 

11 

01 
01 
01 
01 
00 
00 
00 

oo 

01 
01 
10 
10 
00 
00 
00 

oo 
11 
11 
11 
11 

01 
01 
10 
10 
00 
01 
10 

11 

00 
01 
10 

11 

DO 
01 
10 

11 

00 
01 
10 

11 
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TABLE 3.1 



TABLE 3.2 



(HVlONJfDS) 
CONTENTS OF H/V CX)NTROL UNTT 1 641 
COPYR[GHT© 1992 The 3DO Company 



(HV20N.FDS) 
CONTENTS OF IVV CX)NTROL UNIT 1642 
COPYRIOETT© 1992 The 3D0 Company 



CKTNAME: HVION; 

TYPE: COMB; 

INPUTS: VION^ON^,Y^Pxl^0; 

OUTPUTS: MSPxl^SPjcO; 

000000 10 

000001 10 

000010 10 

000011 10 

000100 11 

000101 11 

000110 11 

000111 11 

001000 00 

001001 00 

001010 00 

001011 00 

001100 01 

001101 01 

001110 01 

001111 01 

010000 11 

010001 10 

010010 10 

010011 11 

010100 11 

010101 10 

010110 10 

010111 11 

011000 01 

011001 01 

011010 01 

011011 01 

011100 00 

011101 00 

011110 00 

011111 00 

100000 01 

100001 01 

100010 01 

100011 01 

100100 00 

100101 00 

100110 11 

100111 11 

101000 00 

101001 00 

101010 11 

101011 11 

101100 10 

101101 10 

101110 10 

101111 10 

110000 00 

110001 01 
110010 10 

noon 11 

110100 00 

110101 01 

110110 10 

110111 11 

111000 00 

111001 01 

111010 10 

111011 11 

111100 00 

111101 01 
111110 10 

mill 11 

<END> 



10 



15 



20 



25 



30 



35 



40 



45 



55 



65 



CKTNAME: 
TYPE: 
INPUTS: 
OUTPUTS: 

<Tr> 

000000 
000001 
000010 
000011 
000100 
000101 
000110 
000111 
001000 
001001 
001010 
001011 
001100 
001101 
001110 
001111 
010000 
010001 
010010 
010011 
010100 
010101 
010110 
010111 
011000 
011001 
011010 
011011 
011100 
011101 
011110 
011111 
100000 
100001 
100010 
100011 
100100 
100101 
100110 
100111 
101000 
101001 
101010 
101011 
101100 
101101 
101110 
101111 
110000 
110001 
110010 

noon 

110100 
110101 
110110 
110111 
111000 
111001 
111010 
111011 
111100 
111101 
111110 

111111 

<END> 



HV20N; 
COMB; 

VION^ON^,Y^l,SPxO; 
MSPxl^MSPxO; 

10 
10 
10 
10 

11 
11 
11 
11 

00 
00 
00 
00 
01 
01 
01 
01 

11 
11 
11 
11 

10 
10 
10 
10 
00 
01 
01 
00 
00 
01 
01 
00 
01 
01 
01 
01 
00 
00 

11 
11 

00 
00 

11 
11 

10 
10 
10 
10 
00 
01 
10 

11 

00 
01 
10 

11 

00 
01 
10 

11 

00 
01 
10 

11 
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TABLE 3.3 



(HV20NJDS) 
CONTENTS OF CONTROL UNIT 1643 
COPYRIGHT© 1992 The 3DO Company 
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TABLE 3.3-continued 



(HV20N.FDS) 
CONTENTS OF HA^ CONTROL UNTF 1643 
COFYRIGETT© 1992 The 3D0 Company 



CKTNAME: HV30N; 

TYPE: COMB; 

INPUTS: VION^ON^,TSPxl,SPxO; 

OUITUTS: MSPxl^SPjcO; 

000000 10 

000001 10 

000010 10 

000011 10 

000100 11 

000101 11 

000110 11 

000111 11 

001000 00 

001001 00 

001010 00 

001011 00 

001100 01 

001101 01 

001110 01 

001111 01 

010000 11 

010001 11 

010010 11 

010011 11 

010100 10 

010101 10 

010110 10 

010111 10 

011000 00 

011001 01 

011010 01 

011011 00 

011100 oo 

011101 01 

011110 01 

011111 00 

100000 01 

100001 01 

100010 10 

100011 10 

100100 00 

100101 oo 

100110 00 

100111 00 

101000 11 

101001 11 

101010 11 

101011 11 
101100 01 
101103 01 

101110 10 

101111 10 
110000 00 



10 



15 



20 



25 



30 



110001 


Ui 


110010 


10 


110011 


11 


110100 


00 


110101 


01 


110110 


10 


110111 


11 


111000 


00 


111001 


01 


111010 


10 


111011 


11 


111100 


00 


111101 


01 


111110 


10 


111111 


11 


<END> 





Miscellaneous Other Tables: 

TABLE 3.4 



35 



40 



45 



Eneine CQDtrol Data Structure 

In addition to the CPU, there is a SPRYTE-rendering engine 
operativcly coupled to the VRAM for writing image data into the 
VRAM. The CPU loads a general SPRYTE-rendering engine control 
word into a hardware address to control the Spryte-engine. The bits 
of this control word indudc those which manipulate the subposition 
bits before they are stored in VRAM. TTie control word structure is as 
follows: 

Bits Name Description 

B31:B30 - B15P0S B15 oPEN selector for output of a PMPP 
section within the Spryte engine. (This bit 
can function as a subposition defining bit 
that is used by the pre-display intcrpolatcr.) 
0 - reset it to 0, 1 = set it to 1, 2 » xx, 
3 - keep it same as Source data 
BO OPEN selector for ouqiul of PMPP- (This 
bit can also function as a subposition 
defining bit that is used by the pre-display 
interpolater.) 0 - 0, 1 = 1, 2 « PPMP math, 
50 3 - same as Source data 

B27 - SWAPETV 1 ° Swap the H and V subpositions prior to 

their entry into the PPMP 
B26 - ASCALL 1 «* Allow siqwr clipping fiinctioo (master 

enable switch) 
B2S - XX Reserved 

B24 - CFBDSUB 1 = use the H and V subposition bits of the 

cFB data in place of (vice) the SPRYTE 
source values when the cFB data is selected 
as a PPMP source, (Note: CFBDsel = (SI = 
1) OR (S2 - 2» 

B23 B22 - CFBDLSB cFBD PPMP Blue LSB source. 0 - 0, 1 = 

cFBD[BO], 2 - cFBD[B4], 3 « x 
B21:B20 - IPNUSB IPN PPMP Blue LSB source. 0-0, 
1 = IPNIBOJ, 2 - PN[B4], 3 - K 



B29:B28 - BOPOS 



55 



60 



65 



NOTE #1: The BOPOS value of '2' is the only setting that uses PPMP 
math to control the BO bit in the actually ou^ut of oPEN signal. When 
this setting is chosen, the Bhie LSB will also be included in the input 
parametcis of the black detector. 
"--_.<END OF TABLE 3.4> 
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TABLE 3.5 



44 



Spiytc Data Preamble Words 



The Spryte-rendering engine is also oontrolled by certain "Preamble 

words that accompany a so-called Sprytwwntiol Block (SCoB). One of the prcniable 

words (the second one) contains controls that affect the subposition bits that are to 

be stored in VRAM. 

Second pieamble word. 

If the PACKED bit (in the SCoB) is '0*. then the source data is totally literal. For 
totally literal Sprytes, there is a second preamble word. It contains the horizontal 
pixel count for each line of the source data and the word offset &om one Ime of 
source data to the next, tt also contains the other special bits needed for toally 
literal Sprytes. Note that these bits are only valid whUe the totally Uteral Spryte is 
being rendered. Ihese bits are not used .. . GATED AWAY ... when the oirrent Spryte 
is not totally Uteral. 

B31— >B24 - WOFFSEIX8). Word offset from one line of data to the 
ncrt (-2) (8 bits). 

bits 23 — >16 of offset arc set to 0. 
B25— >B16 - WOFFSEIXIO). Word offset from one line of data to the 
nat (-2) (10 bits). 

bits 31 — >26 of offset are set to 0. 
B15 = Reserved, set to 0. 

B14 - NOSWAP 1 - disable the SWAPHV bit from the general 

Spryte control word. 
B13— >B12 = TLLSBIPN PPMP blue LSB source. 0 » 0, 1 - IPNlO], 

2 - IPN14], 3 - IPN151. 
Bll « LRFORM Left/ri^t foimat 

BIO— >B0 - TLHPCNT Horizontal pixel count (-1) (11 bit^ 

The TLLSB bits perform the same function that the IPNLSB bits perform in normal 

flPL^ORM - 1 the source data has the frame buffer format of the screen as a source for- 
mat Vertically adjacent pixels in the rectangular display space arc horizontally adjacent m 
the 2 halves of a memory word. TTiis is useful for 16 BPP totally literal. The unpacker will 
disable the FIFO data requests and alternately place pixels from the source into both 
RFOs. Left 16 bits go to 'A* FIFO, right 16 bits go to 'B' FIFO. The dato itqacsts for 
'A'FIFO will be made in a request 'pair' to insure the reduction of page breaks and 6 ticic 
latencies*. The hardware will lode the romer engines (regardless of the IXE ^^)- , 
TLHPCNT is the number of pixels in the horizontal dimension (-1). This ui the nunAcr ot 
pixels that will be atten^ted to be rendered for each horizontal line of the Spryte. Hiis 
value is used by the data unpacker. A '0' in the value will aUempt 1 pixel. A -1 m the 

of the next line (-2). If the BPP for this Spryte is 8 or 16, use WOFFSET(10 , else use 
WOFFSETfSl This number is a zero for the minimum sized Spryte (2 words! 
By ir^^^^^ and TLHPCNT coiiecay, you can extract a rectangular area of 

data our of a larger sized rectangular area of data. ^ ^ . . f.,^!, 

m DMA engini will also use M^OFFSET as the length vahie in the nonnal ^aU f^t^ pK^ 
cess. If WOFFSET ad TLHPCNT are set badly, WOFFSET may expire first and the DMA 
endnc will not cope properly. 
-~<END OF TABLE 3.5> 



In conclusion, it has been shown thai image data is 
advantageously placed within independenUy addressable, 
parallel banks of a multi-bank video random access memory 
unit (VRAM) in order to perform multi-row interpolation 
without need for a row buffer for separately storing the 
image data of one or more entire rows during the multi-row so 
interpolation. It has also been shown that a distance- 
weighted interpolation scheme can be approximated by 
averaging N low resolution values and that such an approxi- 
mation can be canied out in a pipelined system. 

ITic above disclosure is to be taken as illustrative of the 55 
invention, not as limiting its scope or spirit. Numerous 
modifications and variations will become apparent to those 
skilled in the art after studying the above disclosure. 

Given the above disclosure of general concepts and 
specific embodiments, the scope of protection sought is to be 60 
defined by the claims appended hereto. 

What is claimed is: 

1. A method for enhancing the apparent resolution of an 
animated image in an interactive visualization system, the 
method comprising the steps of: 65 

storing low-resolution image data in a memory of the 
visualization system, the low resolution image data 



consisting of an entire displayable frame of an ani- 
mated image to be observed by a user of the visual- 
ization system; 
interpolating the stored low-resolution image data to 
generate a oon-slored high-resolution signal for dis- 
playing a high-resolution image having a higher reso- 
lution than the low-resolution image data, said inter- 
polating comprises: 

dividing each pixel in said low-resolution image data 
into a plurality of subpositions, each subposition 
corresponding to a pixel of said high-resolution 
image and u- u 

providing as an intensity of said pixel of said high 
resolution image a weighted average of intensities of 
a plurality of pixels of said low-resolution image 
data, wherein in said weighted average, said intensity 
of a pixel of said low-resolution image data being 
weighted by a function of the distance between the 
center of said pixel of said high resolution and the 
center of said pixel of said low-resolution image 
data; and 

displaying the high-resolution image on a high-resolution 
video device having a higher resolution than the low- 
resolution image data. 
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2. The method of claim 1, wherein the interpolating step 
comprises: 

responsive to a first activation signal, interpolating the 
stored low-resolution image data in a horizontal direc- 
tion to generate a non-stored high-resolution signal for ^ 
displaying a high-resolution image having a higher 
resolution in the horizontal direction than the low- 
resolution image data. 

3. The method of claim 1, wherein the interpolating step 
comprises: 

responsive to a second activation signal, interpolating the 
stored low-resolution image data in a vertical direction 
to generate a non-stored high-resolution signal for 
displaying a high-resolution image having a higher 
resolution in the vertical direction than the low- 
resolution image data. 

4. The method of claim 1, further comprising the steps of: 
receiving real-time response signals representing real- 
time responses of an observer to the high-resolution ^ 
image on the high-resolution video display device; and 

modifying the low-resolution image data responsive to the 
real-time response signals. 

5. The method of claim 1, wherein the high-resolution 
signal is immediately used to generate a light image detect- 25 
able by a hxmian eye without being stored in the memory of 
the visualization system. 

6. An interactive system having an interactive loop com- 
prised of: 

high-resolution video display device for displaying in 30 
real-time an animated high resolution image; 

interactive input means, positioned for operation by an 
observer of the high-resolution image, for producing 
real-lime response signals representing real-time 
responses of the observer to the high-resolution image; 
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46 

memory means for storing low-resolution image data, the 
low-resolution image data consisting of an entire dis- 
playable frame of an animated imagp to be seen by the 
observer; 

an image-modifying processor, operatively coi^led to the 
memory means and responsive to the real-time 
response signals, for modifying the low-resolution 
image data in response to the real-time responses of the 
observer to the high-resolution image; 

interpolating means, operatively coupled to the memory 
means and to the high-resolution video display device, 
for interpolating the stored low-resolution image data 
to generate a non-stored high-resolution signal for 
displaying a high-resolution image having a higher 
resolution than the low-resolution image data, said 
interpolating means: 

dividing each pixel in said low-resolution image data 
into a phiriity of subpositions, each subposition 
corresponding to a pixel of said high-resolution 
image and 

providing as an intensity of said pixel of said high 
resolution image a weighted average of intensities of 
a plurality of pixels of said low-resolution image 
data, wherein in said weighted average, said intensity 
of a pixel of said low-resolution image data being 
weighted by a function of the distance between the 
center of said pixel of said high resolution and the 
center of said pixel of said low-resolution image 
data. 

7. The system of claim 6, wherein the interpolating means 
comprises switch means for selectively activating and deac- 
tivating interpolation in one or both of a horizontal and 
vertical direction. 

* ♦ * ♦ * 



02/04/2003, EAST Version: 1.03.0002 



